Mysterious Intermittent no video

[Larry_Y_]

We have two identical MCU servers setup. One is a local server and the other is remote.

Chrome version: 51 64-bit

Local MCU: Open the basic example multiple times and the video always shows.

Remote MCU: Open the basic example multiple times and the video shows for the first couple of times and then either customized background only or black background only but no video, close browser and wait for a while. Repeat the above. It's inconsistent. The no video case is about 25% of the time.

Browser log for no video with customized background:

INFO: stream published: 553153661778196700 
INFO: subscribed: 57b4e9864927ebae40d29d5d
The end

Browser log for no video with black background:

INFO: stream published: 478118335362523800
INFO: subscribed: 57b4e9864927ebae40d29d5d
INFO: stream added: 478118335362523800
INFO: stream 478118335362523800 is from me; will not be subscribed.
INFO: stream 57b4e9864927ebae40d29d5d VideoLayoutChanged
The end

Server log:

2016-09-06 23:22:16.413  - INFO: VideoNode - Video engine init OK
2016-09-06 23:22:23,214  - WARN: VideoMixerWrap - Current Regions in Layout:1

2016-09-06 23:22:23,247  - INFO: woogeen.RawTransport - Increasing the buffer size: 3506
2016-09-06 23:22:34,379  - INFO: woogeen.RawTransport - Increasing the buffer size: 5511
2016-09-06 23:22:42,297  - INFO: woogeen.RawTransport - Increasing the buffer size: 7610
video-19104946-a6f9-e926-c043-2eee7329be87.log (END)

It seems that somehow the server has a glitch and does not process full-cycle requests or something happens during the network trip.

Any hint would be appreciated.

If needed, we can open up the server for you to try.

Best,

Larry

[Li__Guangming]

My server in the  Internet network, also have the same problem, can login, chat, but no video, help ah..

[Lei_Z_Intel1]

It would be helpful if you can post your logs here. If you can open the server to us for diagnosis, that would be easier, you can share the information through webrtc_support@intel.com.

[Li__Guangming]

The following is my log ：

2016-09-08 07:18:07.015  - INFO: AMQPER - Exchange rpcExchange is open
2016-09-08 07:18:07.018  - INFO: AMQPER - Exchange broadcastExchange is open
2016-09-08 07:18:07.020  - INFO: AMQPER - ClientQueue amq.gen-YC7SeDv06Y6dmRak-DFhfQ is open
2016-09-08 07:18:07.022  - INFO: ErizoAgent - Adding agent to cloudhandler, purpose: webrtc
2016-09-08 07:18:07.032  - INFO: ErizoAgent - webrtc agent join cluster ok.
2016-09-08 07:18:07.033  - INFO: ErizoAgent - Running process
2016-09-08 07:18:07.035  - INFO: ErizoAgent - Running process
2016-09-08 07:18:07.037  - INFO: ClusterWorker - Join cluster woogeen-cluster OK.
2016-09-08 07:18:07.040  - INFO: AMQPER - Queue webrtc-7ded0625-e48b376a0a6c is open
2016-09-08 07:18:07.042  - INFO: ErizoAgent - ErizoAgent rpcID: webrtc-7ded0625-e48b376a0a6c
2016-09-08 07:19:47.162  - INFO: ErizoAgent - Running process
2016-09-08 07:20:25.840  - INFO: ErizoAgent - 11a742a0-659b-1cee-9e38-5405a3adb973 exit with 0
2016-09-08 07:20:46.138  - INFO: ErizoAgent - Running process
2016-09-08 07:20:56.636  - INFO: ErizoAgent - 4e71cd93-9cbe-8632-809b-c9851887ab73 exit with 0
2016-09-08 07:22:27.242  - WARN: ErizoAgent - Exiting on SIGTERM
2016-09-08 07:22:27.243  - INFO: LoadCollector - To stop load collector.
2016-09-08 07:22:27.243  - INFO: ErizoAgent - Terminate ErizoJS eec99a50-7011-f7c2-a030-38c988704fbf ok
2016-09-08 07:22:27.243  - INFO: ErizoAgent - Terminate ErizoJS a39bc48a-5c4e-3396-47d9-436f6776cb41 ok

[Larry_Y_]

We are going to build a new server to further investigate the issue and will let you know once done. Thanks. -L

[Larry_Y_]

Hi Lei,

The server info has been emailed to webrtc_support@intel.com.

The server is a new build.

Please let me know if you need anything.

Best Regards,

Larry

[Mid_J_]

I am facing similar issue.

it usually comes on some computers.

20- 10% times there is no video from MCU.

There is no error in any logs - client side or server side.

[Lei_Z_Intel1]

Thanks for reporting this and providing the diagnosis environment. Our engineer is looking at that issue and update you once any progress.

[Larry_Y_]

Just FYI, we have set up another cloud server and the same happens.

In summary, all of our remote 4 servers have the same issue while local servers are always good.

[Lei_Z_Intel1]

Hi, Larry

We are working on the problem diagnosis on your shared machine, but can't access now. Can you please help check? Thanks a lot!

Best wishes,

Zhai Lei

[Larry_Y_]

Hi Lei,

It's up now. If needed, we have another server always up.

It might be easier to reproduce if the client machine is in US 

Thank you for looking into it.

Best,

L

[Lei_Z_Intel1]

Thanks Larry for the support. But we are based on China, and let's try reproduce firstly.  

[Larry_Y_]

Sounds good.

Please feel free to create a new room for troubleshooting purpose.

[Larry_Y_]

Hi Lei,

It seems that your team changed the socket io to http. I just changed it back to https so that you should be able to continue the trouble shooting.

With thanks,

Larry

[Lei_Z_Intel1]

We just did some experiment on that. Sorry for the inconvenience. Also we are going to replace some patch binary of Intel CS for WebRTC to test and do restart, not your application. Is that acceptable to you?

[Larry_Y_]

No problem. Please go ahead. We will stay away from the server while you are trouble shooting. 

[Lei_Z_Intel1]

Thanks for support! Will keep you update on the progress.

[Lei_Z_Intel1]

Hi, Larry

We got some progress on this issue and updated the binary on your server. Can you please have a try and let us know whether that can help?

Best wishes,

Zhai Lei

[Larry_Y_]

Hi Lei,

Thank you for your update. We did  some preliminary tests, the mixed video is very reliable and shows every time. The issue seems to be fixed now. 

Kudos to your team!

Larry

[Lei_Z_Intel1]

Hi, Larry

Nice to hear that and thanks again for your support during the problem diagnosis. The official patch will be included in the coming v3,2.1 release.

Best wishes,

Zhai Lei

[Lei_Z_Intel1]

By they way, is that possible to open the server to us one more day to do the final validation for preparing the official patch? And check whether there is some side effect.