Talk:Simple DVB with Gstreamer and GNU Radio
- Building on the success of transferring data between GNU Radio and multimon using a named pipe, I decided to try the same trick to send real time video from Gstreamer to GNU Radio. It worked!
- Implemented a simple video transmission simulator by sending the video through a GMSK modulator, adding noise, then GMSK demodulator. See recorded video.
- Although the MPEG-TS muxer available in Gstreamer can not deliver CBR, sending the GMSK modulated video to the USRP didn't seem to be a problem.
- Having only one USRP I didn't try to receive and decode the video.
- Successful on the air tests of the DVB setup using a videotestsrc
- Location: OZ7SAT
- Repeated on the air tests at OZ7SAT (to be sure that it wasn't just some sort of random luck)
- Video test source: http://www.youtube.com/watch?v=2VUZ7H60F68
- Logitech Webcam Pro 9000: http://www.youtube.com/watch?v=RzIe_IWGvmA
- At Høm for the weekend and only brought one USRP and one laptop
- Created a full duplex transceiver version of the GMSK TX+RX so that I could run both transmitter and receiver using only one USRP and computer: http://www.youtube.com/watch?v=dJg2zAd3kRY
- The transceiver was running stable for more than 4.5 hours, see last screenshot.
- With this setup, the video appeared to be more choppy than with the two-computer setup.
- Imported the source code to http://github.com/csete/gnuradio-dvb
- GMSK modulator generates 2 samples/symbol and I have 1 bit/symbol. Therefore, the input data rate to the GMSK modulator should be 500 kbps for a 1 Msps stream to the USRP.
- The packet encoder adds 12 bytes overhead to each packet – at least when using default access code. With a payload size of 4000, this overhead corresponds to 1.5 kbps.
- Setting H-264 encoder bitrate to 498 kbps (didn't make much difference).
- Found a very interesting example in the py-gst repository for how to switch between different video sources, see http://cgit.freedesktop.org/gstreamer/gst-python/tree/examples/switch.py
- Tried to make a simple video input switcher based on the switch.py example and although I can switch between the inputs, I can not have both local monitor and H.264 encoder attached to the output (using a splitter of course). This is weir since I have done pretty much the same in my webcam example in the Gstreamer Cheat Sheet.
- Found out the problem is connecting the splitter to H.264 -- the setup works fine using theoraenc!
- Found out that on Ubuntu 9.10 the multicam.py also works with H.264
- The Gstreamer packages are the same on 9.10 and 10.04 (I use PPA), but, the x264enc plugin is in the plugins-ugly-universe, which is Ubuntu and not PPA package. So it could be either due to libx264 or x264enc plugin or both.
- The input-selector appears to cause 100% CPU load on one core. Confirmed by executing two equivalent pipelines without input-selector which had much lower CPU load.
- Created a mapping between Pixel formats for camera, fourcc and gstreamer.
- Tested Theora in Ogg container using videotestsrc and the simulator. Worked very well.
- Tested the Theora version using the gmsk_trx script. Worked well and very stable for 2+ hours using the videotestsrc.
- With camera it looses sync after a few minutes and mplayer spits out "Ogg: bad packet in stream 0" messages.
- Pushed updated code to http://github.com/csete/gnuradio-dvb
- Made a blog post about the Theora+Ogg experiment.
- Did a few experiments studying the video freeze every 2 seconds (for ~300 msec). Noticed it before but didn't look into the problem in details.
- Used the transceiver setup (only have one USRP at the moment)
- The freeze occurs at any frame rate and video size and is always 2 seconds
- The freeze only occurs when I have both USRP and camera connected - the stream runs smoothly when using a video test pattern (no camera)
- Packet encode payload size or "Pad for USRP" does not make any difference
- Also freezes when using pre-recorded video file as input to GNU Radio → It is not Gstreamer
- Also freezes when running in simulator mode → It is not the USRP (Uhm... This is TBC! I think it is just a typo in my notes)
- Confirmed that the freeze every 2 seconds also occur on the much faster (i7) computer
- Setup tested again using separate RX and TX: The video freezes every 2 seconds also occurs in this case just as when running in transceiver mode
- Tried to connect USRP and webcam on different USB hosts → still have the freeze
- OZ2ABA suggested to add a monitor to the to see if it can narrow down where the problem occurs (at this point I forgot about the results with the simulator and the file input to GR, see 2010.09.05)
- Thinking that I should maybe also try an UDP interface between Gstreamer and GNU Radio on the TX side.
- Reran the setup in the simulator and as expected, no freezing in the stream (c.f. last note from 2010.09.05)
- Tried adding a TX monitoring FIFO to the TRX flow graph → it's choppiness was much worse than the receiver. The freezes cam much more frequently and seemed to be irregular. Same result when using the TX-only flow graph.
- Tried playing a bit with the filesink parameters (sync, async, buffered) but didn't make any difference. There are still some buffer sizes but I find it difficult to understand what the various parameters control. I guess I will have to look at the source code for that.
- Got a message from Gallamine that the experiment DVB setup was used to do streaming video over an underwater laser link :)