Difference between revisions of "Embedded Video Processing and Radio Unit"
|Line 20:||Line 20:|
=== Camera ===
=== Camera ===
The camera can be either CCD or CMOS. It sends [http://en.wikipedia.org/wiki/RGB RGB] or [http://en.wikipedia.org/wiki/YCbCr YC<sub>b</sub>C<sub>r</sub>] data to the Video encoder and receives control signals from the Camera controller. These can be gain, shutter speed, capture size, etc, depending on the camera used.
The camera can be either CCDor CMOS . It sends [http://en.wikipedia.org/wiki/RGB RGB] or [http://en.wikipedia.org/wiki/YCbCr YC<sub>b</sub>C<sub>r</sub>] data to the Video encoder and receives control signals from the Camera controller. These can be gain, shutter speed, capture size, etc, depending on the camera used.
=== Cam control & Video encoder ===
=== Cam control & Video encoder ===
Revision as of 13:42, 1 June 2009
The embedded video processing and radio unit (VPRU) is a small, high performance single board computer for capturing and transmission of high definition video and for providing a simple TM/TC interface for the system it is built into.
- 1 Requirements
- 2 Functional Overview
- 3 Development Approach
- 4 Initial Analysis
- 5 Further Reading
- 6 References
- Capture high quality video in 640x360 and 1280x720 pixels, 25 fps, progressive scan
- Perform some basic compression of the video stream in real time
- Provide a TM/TC interface to other processing units
- Interleave telemetry from other processing units and the video stream and transmit it over a radio link
- Receive telecommands via the radio and forward them to the other processing units
Nice to have requirements:
- Pan, tilt, and zoom
- Transponder functionality in the radio unit for ranging
The figure below shows an overview of the desired functionality. Note that a box represent a function that may be implemented by hardware, software or both. Similarly, the arrows represent data flow that could be function calls in software or signals through a wire. 800px
The camera can be either CCD or CMOS (a.k.a. active-pixel sensor camera). It sends RGB or YCbCr data to the Video encoder and receives control signals from the Camera controller. These can be gain, shutter speed, capture size, etc, depending on the camera used.
Cam control & Video encoder
This function has two purposes:
- Compress and encode the video data received from the camera.
- Send control signals to the camera.
These two functions are quite different, nonetheless they are listed as one function because controlling the camera settings is often done in a closed loop.
Video processing and transmission can performed in three different modes:
- High-rate TM: The high quality video is forwarded in real-time at its original size to the TM encoder. This mode is used when there is sufficient radio bandwidth for high-rate transmission.
- Low-rate TM: The high quality video is stored in the Storage at its original size for later retrieval and a reduced-size preview is forwarded in real-time to the TM encoder. This mode is used when the radio link can only provide sufficient bandwidth for low rate transmissions.
- Retrieve: This mode is used when the capturing was done in the Low-rate TM mode and the high quality & size video needs to be downloaded in non-real time.
The Cam control and video encoder function receives telecommands directly from the TC decoder. These commands include everything related to video processing (e.g. preview size), including camera control commands.
The data storage is used for storing video for later retrieval when only low-rate TM transmission is possible.
The telemetry encoder receives video data stream and telemetry data from the video encoder and interleaves them with telemetry from other sources. The interleaved telemetry stream is sent to the Digital Signal Processor of the radio unit.
The TC decoder receiver telecommand data from the Digital Signal Processor of the radio unit and decodes them. Camera and video related commands are sent to the Camera controller, other TCs are sent to the Auxiliary Units.
DSP: Digital Signal Processor
A/D and D/A
There are the analog-to-digital and digital-to-analog signal converters in the radio unit. The reason for explicitly including them on the diagram will be clarified later on.
RX and TX
These are RF parts of the radio unit. The transmitter (RX) converts the baseband signal from the DSP/DA into a high frequency carrier wave. The receiver (RX) takes the received carrier and extracts the baseband signal from it, and sends it to the AD/DSP.
Antenna match & Diplexer
This has been added to allow using the same antenna for both transmission and reception.
This has been included to allow interaction with other on-board units so that they can share the RX/TX connection.
The VPRU is going to be developed in three incremental iterations resulting in three prototypes:
- First Prototype
- This prototype will focus on the video processing functionality and the TM/TC interface. For the radio part, a simple Wi-Fi interface will be used allowing laptops and handheld devices to act as hosts.
- Second Prototype
- This prototype will focus on the radio unit and implement the transponder functionality.
- Third prototype (TBC)
- This prototype will focus on adding the pan tilt and zoom functionalities and will be likely to replace the camera unit from the first and second prototypes.
Two processors from Texas Instruments are evaluated:
Both are based on the DaVinci™ technology and contain hardware accelerators for video processing (both front end and backend). The OMAP2530 also contains a C64x+ DSP using which Software defined radio functionality could be implemented.
While these may not provide the best solution, they are relatively easy and cheap to get started with, because development environments are available in the form of the Beagle Board, the Leopard Board, and the Gumstix series.
To begin with, following borads have been acquired:
- Leopard Board that comes with a VGA camera and a 5 Mpix camera.
- Gumstix Overo Fire with the Summit expansion board.