CN101692693A - Multifunctional integrated studio system and a method for producing radio and television programmers or films - Google Patents

Abstract

The invention relates to a multifunctional integrated studio system and a studio method. The present invention comprises: a computer with a mouse and a keyboard connected to an external video signal source and an external audio signal source, the computer is provided with a multi-channel video input circuit, a multi-channel video acquisition buffer, a multi-channel acquisition and recording encoder, and a memory , a mixing console device, a built-in video input signal source, a virtual studio device, a computer is also provided with a control operation analysis unit connected with a touch screen display, an external switcher and the mouse, a keyboard, a central processing unit and an output buffer, and multiple Screen splitting and screen signal converter. The present invention modularizes the system equipment such as switcher, mixer, video recorder, player, subtitle machine, editing, broadcasting, virtual studio, TALLY system, TV wall and so on in the traditional studio, and integrates these Modules are seamlessly integrated.

Description

A multifunctional integrated studio system and studio method

technical field

The invention relates to a multifunctional integrated studio system and a studio method, which is a system and method for digital image processing, and a digital image processing system and method for various studios.

Background technique

As an important place for TV program production, the studio undertakes most of the program recording and production tasks except for shooting programs. The studio involves the shooting, synthesis, broadcasting and other links of program production. Studio program shooting is the preparation stage of program production, providing original materials for the entire program; studio broadcasting is an application that integrates program production, synthesis and broadcasting , directly provide the program into film signal.

Usually, the studio needs to do the following work: play existing materials, collect real-time signals of multiple cameras on the spot, switch or synthesize the video signals of the cameras and the video signals played by the existing materials, The tone of the sound signal picked up by the on-site microphone is adjusted, and the subtitle image is edited and formed by the subtitle machine, and the subtitle image is superimposed on the synthesized video signal through the switcher, and the final synthesized video signal and audio signal are broadcast or recorded. The above-mentioned links are traditionally completed by separate equipment, for example: use a special video tape player to play existing materials, use a dedicated hardware switcher to complete signal synthesis and switching, and use a mixer to complete multi-channel audio mixing. Audio, use an independent subtitle machine to complete subtitle editing and rendering output, and use a special video tape recorder to complete the recording of the finished program. In this case, a lot of independent physical equipment is required to realize the complete studio function, and the connection of various video and audio signal input and output cables and control signal cables is very complicated between different equipment. Not only is the system costly to build, but maintenance and use are also very complicated, and because there are many complex links in the connection relationship, failures often occur more frequently, which affects the normal use of the studio.

So far, the development of the studio has mainly gone through three stages: the traditional studio, the semi-documented studio and the documented studio.

traditional studio

In a traditional studio, broadcasting and recording are all done through video players and video recorders. When broadcasting materials, it is first necessary to record the video materials broadcast in the studio onto multiple tapes, and then manually broadcast these video materials through multiple video players. When recording material, it is necessary to use a video recorder to first record the material to a tape, and then use the editor to edit it.

The main problem is that the hardware investment is high, and the broadcasting and recording of materials are all through tapes, so its efficiency is relatively low, there will be a certain loss in signal quality, and there are a certain amount of consumables (such as drums, tapes, etc.) wait).

semi-documented studio

With the development of technology in the radio and television industry, video and audio broadcasts have begun to adopt a documented approach. Some TV stations use video and audio servers in the studio system for broadcasting. Before broadcasting in the studio, the materials to be broadcast need to be uploaded to the video server through video and audio signals, and then the video server is controlled for broadcasting. Video servers are also used to record studio signals, but the collected files cannot be used directly. They need to be downloaded into tapes in the form of signals before they can be provided to other devices for use.

The main problem is that although this mode uses documented equipment, the use process is not smooth, so it does not exist for a long time and has few applications.

Documentation Studio

At present, the production of most TV programs adopts nonlinear editing system, and with the development of technology, the use of nonlinear is becoming more and more network-based. The large-scale use of nonlinear editing systems means that the TV station's program production system has been documented, so it is obviously a waste of resources and inefficient to use tapes for studio broadcast and recording of programs. Therefore, in the documented studio system, the video and audio files have been directly sent to the studio system for broadcasting. At the same time, the studio recording also uses documented equipment, and the recorded video and audio files are directly sent to the production network for editing or input. Media assets. Documentation is the current mainstream and trend in the studio.

At present, the main problems of document-based studios are that purely document-based studios require large capital investment, various studio equipment, complex system construction, and difficulties in product upgrades, etc., and the participation of professional and technical personnel is required from construction to final use.

Contents of the invention

In order to solve the problems of the prior art, the present invention proposes a multifunctional integrated studio system and broadcasting method. The system and method realize the functions of most of the equipment in the original studio on one computer, and realize multiple information Switching and special effects between sources. The system and method divide the screen displayed on a large screen, and the switching operation of multiple acquisition sources is displayed on the large-screen touch screen to complete, and the large-screen touch screen uses touch to realize signal switching, timbre adjustment, and subtitle playback etc. control.

The object of the present invention is achieved like this: a kind of multifunctional integrated studio system, described system comprises: a computer with mouse and keyboard connected with external video signal source and external audio signal source, described The computer is provided with a multi-channel video input circuit connected to the external video signal source, and the multi-channel video input circuit is connected to a multi-channel video acquisition buffer that supports independent acquisition and recording of each input signal. The acquisition buffer is connected to the multi-channel acquisition and recording encoder, and the multi-channel acquisition and recording encoder is connected to the memory; the computer is provided with a multi-channel audio input circuit connected to the external audio signal source, and the multi-channel audio The input circuit is connected to a multi-channel audio acquisition buffer that supports independent acquisition and recording of each input signal; a multi-channel audio material source is also provided in the computer, and the multi-channel audio material source is connected to a multi-channel audio decoder. The multi-channel audio decoder is connected to the multi-channel audio material source buffer, and the multi-channel audio acquisition buffer and the multi-channel audio material source buffer are connected to the mixer device; the computer is also provided with a built-in video input signal source The computer is also provided with a virtual background device; the computer is also provided with a control operation analysis unit connected with a touch screen display, an external switcher and the mouse and a keyboard, and the control operation analysis unit is connected with a function control analysis unit ; The video capture buffer, the mixing console device, the built-in video input signal source, and the function control analysis unit are connected to the central processing device; the central processing device is connected to the output buffer, multi-picture division and screen signal converter; Said output buffer is connected with multi-picture division and screen signal converter, output circuit, real-time streaming media encoder, broadcast recording encoder supporting real-time recording of main output signal; said multi-picture division and screen signal converter Be connected with large-screen display and audio equipment, described touch-screen display; Described output circuit is connected with the TV network as broadcasting output; Described real-time streaming media encoder is connected with streaming media publisher, and streaming media publisher is connected with The computer network as the network output is connected; the broadcast recording encoder is connected with the memory.

A multifunctional integrated broadcasting method using the above system, the steps of the method are as follows:

Steps to collect images and sounds: If the external video and audio signal source is a camera, it is used for the camera to convert the scene into an electronic image signal and electronic sound signal. If the external video and audio signal source is a device that provides SDI, 1394, HDMI and VGA signals, Including: video camera, Blu-ray disc video recorder, hard disk video recorder, video server, satellite receiver, tape video recorder, non-linear editing machine, one of which directly obtains video signal and audio signal;

Steps for format recognition:

If the external video signal source is a camera, it is used to identify whether the format of the image signal output by the camera is digital or analog, and if it is digital, it is necessary to identify which one of SDI, 1394, HDMI, and VGA;

If the external video signal source is one of Blu-ray disc player, hard disk player, or video server, it is also necessary to identify which format of the image signal output by the external video signal source is SDI, 1394, HDMI, or VGA;

Simultaneously with the above-mentioned collecting video and audio signal source input step and format identification step is the step of obtaining subtitles, existing material, background and virtual studio scene from the built-in video input signal source, that is: the step of generating subtitles by the subtitle device, from the existing There are steps of obtaining existing materials from the material storage, steps of obtaining the background from the background device, and steps of generating a virtual studio scene by the virtual studio device;

Steps to generate subtitles in the subtitle device:

The subtitle device contains a subtitle editing device, a subtitle memory, a subtitle generator and a subtitle cache, and the subtitle editing device first performs the production work of a subtitle template and a subtitle content, and the described subtitle editing device is connected with the subtitle memory, and in the subtitle device A subtitle generator is included, and the subtitle generator obtains the prepared subtitle template and subtitle content from the subtitle memory to generate subtitles, and the subtitle generator is connected with the subtitle buffer, and sends the generated subtitle signal into the subtitle buffer.

Steps to get the existing material from the existing material memory:

The existing material playback device contains an existing material storage, an existing material decoder, and an existing material cache, the existing material storage is connected to the existing material decoder, and the existing material decoder is connected to the existing material cache . The existing material decoder decodes the existing material in the existing material storage, and sends the decoded video content into the existing material cache, so as to complete the acquisition of the existing material.

Steps to get background from background device:

The background device includes a background memory and a background cache, and the background cache acquires background picture files from the background memory.

Steps for virtual studio device to generate virtual studio scene:

The virtual studio device includes a virtual scene making device, a virtual scene storage, a virtual scene generator and a virtual scene cache. The virtual scene making device is connected with the virtual scene storage, the virtual scene storage is connected with the virtual scene generator, and the virtual scene generator is connected with the virtual scene cache. The virtual scene making device sends the created scene into the virtual scene storage, and the virtual scene generator obtains the scene from the virtual scene storage and generates a virtual scene, and finally sends it into the virtual scene cache.

Steps of input buffering: used to collect video and audio signals, subtitle content generated by the subtitle generator, background image content in the background device, existing material obtained from the existing material decoder, and virtual scene generated by the virtual scene generator. The scene is sent to the cache and updated synchronously;

The processing steps of the central processing device: it is used to select the video signal and audio signal in each input buffer, and superimpose and synthesize the broadcast image composed of subtitles and sound effects, which can be achieved by operating the mouse, keyboard or touch screen display The way of Direct Touch is used to switch between various video signals. The switching process allows the use of special effects switching. The special effects are: fade in and fade out, wipe image, picture in picture, three-dimensional special effect switching effect, or virtual background processing. and HD/SD conversion;

The step of output buffering: it is used to enter the video signal and audio signal input from each channel, as well as the edited video signal and audio signal into the buffer and update them synchronously;

The video and audio signals output from the output buffer are divided into four channels;

The first way: the step of dividing the image: it is used to gather multiple input video signals and output video signals in one picture and divide the picture to assign the position of each video signal in the picture;

Display steps: the large-screen display and the touch-screen display use split images to display various input video signals, audio signals, output video signals, and output audio signals, as well as the control windows of each control device, including: virtual studio control buttons and expanded The control window after the background device, the control button of the background device and the control window after expansion, the control button of the existing material playback device and the control window after expansion, the control button of the special effect device and the control window after expansion, the control button of the subtitle device and the control window after expansion The control window of the control window, the control button of the mixer device and the expanded control window, the control window of the soft switcher control device, and at the same time monitor the control operation of each control device in the entire display area;

The steps of the feedback command: control the operation by operating the mouse, keyboard or Direct Touch of the touch screen display, so as to realize the control of the entire studio process;

Among them, in the way of Direct Touch, the corresponding control operation is first obtained by the touch screen, and the operation mode corresponding to the corresponding control operation is recognized by the touch screen sensing device, such as dragging, clicking, and releasing. Then the touch screen calls the corresponding control commands and related functions of the area or position according to the operation mode of the corresponding area and position, such as signal switching, special effect superposition, mixer control, subtitle superposition, existing material playback, virtual Operations such as studio setup, background setup, etc. In this way, the touch screen display can control the entire studio process.

The second way: the step of encoding the broadcast signal: used to encode the broadcast signal to form a program file;

The step of storing the broadcast signal encoding file: storing the program file formed after the broadcast signal encoding in the memory;

The third way: the step of broadcast signal streaming media processing: while storing the program files, perform streaming media encoding processing on the programs in the output buffer;

The step of broadcasting program streaming media files into the network: outputting the streaming media program files processed by streaming media encoding to the computer network;

The fourth channel: the step of broadcasting signal output: it is used to send the output video signal and audio signal in the output buffer to the TV network for broadcasting through the output circuit.

Simultaneously with the processing steps of the above-mentioned central processing device and the steps of output buffering and broadcasting, external signals are recorded. This step includes: the steps of encoding the external signals and the steps of storing the encoded files of the external signals:

The step of encoding the external signal: the video acquisition buffer and the mixer device are connected to the acquisition and recording encoder, and are used to complete the encoding of the video content and audio content of the external signal to form an external signal encoding file.

The step of storing the encoded file of the external signal: the acquisition and recording encoder is connected to the memory, and the file generated after encoding the external signal is sent into the memory to complete the recording of the external signal.

The beneficial effects produced by the present invention are: in order to solve some problems faced by the development of the studio at the present stage, the present invention realizes the synthesis of the functions of many devices in the traditional studio, which itself is equivalent to a miniaturized studio system, Can independently complete most of the work of the studio system. The present invention modularizes the system equipment such as switcher, mixer, video recorder, player, subtitle machine, editing, broadcasting, virtual studio, tally system, TV wall, etc. in the traditional studio, and integrates these The modules are seamlessly integrated, and finally integrated into a multi-functional integrated studio system. While the studio system is integrated, the present invention creatively proposes to use the touch screen to complete the signal switching, sound adjustment, multi-picture function, subtitle superimposition, program broadcasting, and signal recording of the studio under the use environment of the studio. , virtual set and other functional workflows. Multi-channel signal input and buffering are used to realize signal switching and special effect switching; multi-screen splitting and display are realized by multi-screen splitting; multi-format is realized by setting external video signal source and built-in video input signal source and setting multiple buffers Multi-channel acquisition; and multiple encoders are set to realize real-time storage of the collected input signals, which is equivalent to real-time recording. Set the decoder and cache of the existing material to realize the playback of the existing material. Set up a virtual background device to realize a virtual background studio. Set the TALLY controller to realize the control of the TALLY light. Set up the mixer device to realize tuning on the touch screen. Set the subtitle device to realize the multi-camera subtitle broadcast function. Set up real-time streaming media encoding and streaming media publisher to realize real-time streaming media publishing. A touch screen display, a control operation analysis unit and a function control analysis unit are set to realize the application mode of the DirectTouch touch screen. The central processing device can realize HD/SD conversion and realize HD/SD compatibility.

Description of drawings

The present invention will be further described below in conjunction with drawings and embodiments.

FIG. 1 is a schematic diagram of a multifunctional integrated studio system according to Embodiment 1 of the present invention;

Fig. 2 is a schematic diagram of each control function button in a closed state in the split screen of the multifunctional integrated studio system described in Embodiment 7 of the present invention;

Fig. 3 is a schematic diagram showing that the special effect control button in the split screen of the multifunctional integrated studio system described in Embodiment 7 of the present invention is expanded into a special effect control window, and the soft switcher control button is expanded into a soft switcher control window;

Fig. 4 is a schematic diagram of arbitrarily combining each display window of the split screen of the multi-functional integrated studio system described in Embodiment 7 of the present invention;

Fig. 5 is a block flow diagram of the multifunctional integrated presentation method according to the eighth embodiment of the present invention.

Detailed ways

Embodiment one:

This embodiment is a multifunctional integrated studio system, as shown in FIG. 1 . The system includes: a computer with a mouse and a keyboard connected to an external video signal source and an external audio signal source, the computer is provided with a multi-channel video input circuit connected to the external video signal source, and the multi-channel video The input circuit is connected to a multi-channel video acquisition buffer that supports independent acquisition and recording of each input signal, the multi-channel video acquisition buffer is connected to a multi-channel acquisition and recording encoder, and the multi-channel acquisition and recording encoder is connected to a memory. The computer is provided with a multi-channel audio input circuit connected to an external audio signal source, and the multi-channel audio input circuit is connected with a multi-channel audio acquisition buffer. The computer is also provided with a multi-channel audio material source, the multi-channel audio material source is connected to a multi-channel audio decoder, and the multi-channel audio decoder is connected to a multi-channel audio material source that supports independent collection and recording of each input signal Buffer connection, the audio acquisition buffer, the audio material source buffer and the mixer device are connected. The computer is also provided with a built-in video input source. The computer is also provided with a virtual background device. The computer is also provided with a control operation analysis unit connected with the touch screen display, the external switcher, the mouse and the keyboard, and the control operation analysis unit is connected with the function control analysis unit. The video acquisition buffer, the mixer device, the built-in video input signal source, and the function control analysis unit are connected with the central processing device. The central processing unit is connected with output buffer, multi-picture division and screen signal converter. The output buffer is connected with the multi-screen splitting and screen signal converter, the output circuit, the real-time streaming media encoder, and the broadcast recording encoder supporting the real-time recording of the main output signal. Multi-screen splitting and screen signal converters are connected with large-screen displays, audio equipment, and touch-screen displays. The output circuit is connected with the TV network as broadcast output. The real-time streaming media encoder is connected with the streaming media publisher, and the streaming media publisher is connected with the computer network as network output. The broadcast record encoder is connected to the memory.

The computer adopted in this embodiment is a configuration platform of dual quad-core CPUs, a general-purpose operating system is installed, and special-purpose video boards and audio boards are configured. The central processing device described in this embodiment is not a central processing unit (CPU) in the general sense, but a comprehensive device specially used for multiple functional applications such as signal/stunt switching, subtitle superimposition, HD/SD conversion, and the like.

In terms of video, it adopts high/standard definition digital IO board, supports input of 6 channels of high/standard definition digital signal and 4 channels of 1394 signal (the total number does not exceed 6 channels), supports output of high/standard definition digital signal of PGM and PVW, and supports DVI at the same time signal output.

In terms of audio, it supports 6 channels of AES/EBU digital audio and 6 channels of analog audio selection input (the total number does not exceed 6 channels).

Multiple inputs, signal switching and trick switching

In this embodiment, the embedded multi-channel digital stunt platform is realized by means of multiple input and multiple buffers, and multiple channels can arbitrarily select SDI, 1394, HDMI, i-VGA and hard disk material as input signals. And through the software design, the function of the traditional switcher is realized. This part of the software includes the special effect production module, which supports various common switching special effects, including fade in and fade out, wipe, picture in picture, three-dimensional special effects, etc., because the special effects are created by the input and output buffer It is realized by adding the corresponding special effect algorithm to the image file stored in , so when switching video signal A to video signal B, first copy the video signal A in the input buffer to the output buffer, and then copy the video signal in the input buffer After signal A and video signal B in the output buffer are superimposed and processed, they are copied to the output buffer, and the superimposed operation selects the corresponding algorithm for the corresponding special effect, and the video signal B in the input buffer is copied to the output buffer to complete the A to B video The switching of signals with special effects can realize the production of new special effects by changing the special effect superposition algorithm, that is, calling, so as to realize the expansion of the special effect form. For signal switching, first select the output signal of the PVW window and PGM window by DirectTouch or mouse click, then select the function button corresponding to the effect, open the effect selection window to select the effect template to be applied, and then use the T-bar on the soft switcher Realize manual stunt switching, or touch and press (mouse click) the AUTO button to realize automatic stunt switching, and also realize non-stunt switching through the CUT button. In the selection of the special effect template, the special effect production module can also be mobilized through the shortcut key to design the special effect independently, so as to realize the updating and expansion of the special effect mode.

Multi-screen splitting device

This embodiment adopts multi-screen splitting and a screen signal converter to realize the multi-screen splitting and displaying function. Each screen can be arranged in any combination, and the corresponding input and output signals can be monitored in real time in the multi-screen display window. External video signal sources include cameras, Blu-ray disc players, hard disk players, and video servers. The built-in video input signal sources include existing material signals, subtitle signals, background signals, ready-to-broadcast signals, and currently-broadcast signals, etc. Each signal in the multi-screen echo window domain can be displayed on the touch screen, and can also be output to a large-screen display through DVI signals for split display or separate display. The multi-screen splitter can combine echo windows arbitrarily, and adjust the position and size of each echo window by touching the touch screen or dragging the mouse, so as to finally realize any combination of multi-screen splits.

Multi-format multi-channel acquisition device

This embodiment has the function of recording multiple channels at the same time, and the recording format can be freely defined. While recording the composite signal, it can also record the signal entering each channel, which can be used for post-editing. Its function is equivalent to multiple DVR. Realization of multi-format and multi-channel acquisition: On the software interface, there are buttons for recording and stopping recording on the interface of the echo window of each external signal and the interface of the PGM echo window, which can be directly clicked to start by touching the touch screen monitor Record or stop recording (mouse click also works).

After the studio program is finished, it needs to be recorded. Traditional studios use video recorders to complete this work. Therefore, when multi-channel signals need to be recorded, multiple video recorders must be equipped. The cost is very high, and post-production Sometimes it is very troublesome, you need to keep changing the tape, or upload the tape to the NLE. This embodiment provides a multi-channel recording function, supports real-time recording of the main output signal, supports independent acquisition and recording of each input signal, supports commonly used video and audio formats, can customize the recording format, supports dual-channel acquisition, and collects The material is saved as a file, which is convenient for later editing. When you want to record a signal, just click the record button on the corresponding screen to record it.

In this embodiment, multi-format and multi-channel acquisition and recording can be performed on six external signals and one main output PGM signal during the program production process.

That is, this embodiment supports real-time recording of the main output signal, supports independent acquisition and recording of each input signal, supports commonly used video and audio formats, can customize the recording format, supports dual-channel acquisition, and saves the collected materials as files , which is convenient for later editing.

The specific implementation method is: the video signal and audio signal to be recorded pass through the video encoder and audio encoder, and according to the system configuration of this embodiment, the material in the preset acquisition format is generated. In the signal recording process, the buffer mechanism is adopted, and the token ring is used to slow down the encoding speed during the peak period of CPU occupation, and accelerate the encoding speed during the low period of CPU occupation, thus finally ensuring the smooth and stable recording of video and audio signals.

Existing material playback device

This embodiment can support the function of dual-channel playback. In view of the modular design concept, the material selection and playback of the two channels are respectively two independent software modules, so the two channels are completely independent, which is equivalent to the two channels in the studio. Two video players. It can control the playback, pause and stop of the material, and realize the functions of continuous broadcast, breakpoint broadcast, order broadcast, entry and exit point broadcast, and loop broadcast through software design.

This embodiment supports the simultaneous playback of two channels of existing materials, which can be used to broadcast materials such as titles, clips, small clips, and advertisements. You can customize the broadcast list of materials, and you can add materials to the play list by selecting files. You can adjust the play order, set the in and out points of material broadcast, and support breakpoint playback and continuous playback. You can control the playback stop action of the existing material through the control buttons: play, pause, stop, or automatically trigger the playback stop action of the existing material through the PGM window. Through the existing material control module, open the file dialog box, select the material to be played, add it to the material playlist, and the video decoder and audio decoder will complete the video decoding work and audio decoding work respectively, and the decoder can automatically identify SD material, HD material, and according to the system settings, provide SD and HD signals in YUVU or ARGB format. The material automatically completes the state of preparation for playback. Audio station, in order to ensure stable broadcasting, material decoding adopts a buffer mechanism, uses token ring, slows down the decoding speed when the CPU utilization rate peaks, and speeds up the decoding speed when the CPU utilization rate is low, so as to finally ensure the smoothness of video and audio broadcasting Smooth, steady going.

virtual studio installation

In this embodiment, a virtual studio device is set to realize a virtual studio function, support input and output of (DV, HDV/DVCAM, DVCPRO), and perform high-performance real-time chroma key processing on signals. The foreground signal containing the blue screen background picked up by the camera is sent to the chroma keyer in the virtual studio system, and synthesized with the graphic background signal output by the computer to form the final synthetic signal of the virtual studio system, which can realize the occlusion and crossing of virtual objects and foreground .

The function of the virtual studio can replace the PGM window and the PVW window with a virtual studio. In use, there is a corresponding virtual studio control icon in the function control area at the bottom of the interface, click this icon to open the lens list of the virtual studio, select the background picture or background video corresponding to a certain camera position, and then click the color key button 1. Snapping the image of PGM and closing the screen, you can replace the background in PGM. Also click the color key button 2. Snapping the image of PVW, you can replace the background in PVW. This part of the present invention mainly carries out buckling processing on the signal source of the blue background or the green background, and its realization mode is, after using the video picture taken by the blue screen or the green screen and the set background picture to be pushed into the special effect processing queue, use The method of chroma key button image removes the blue screen or green screen and synthesizes it with the background screen, and the processed screen can be used for output. The background picture can be set as a picture or a video picture.

TALLY device

In the present embodiment, each input and output echo window in the multi-picture echo display window domain has a TALLY light indication, and the red light identifies the signal currently being output, that is, the signal source of the PGM; Signal, that is, the signal source that identifies the PVW. At the same time, the tally signal can be provided to the camera, which is convenient for the staff to identify the equipment that is working.

Mixer device

This embodiment has a built-in multi-channel mixer for the setting and adjustment of studio sound. Setting and operation of the mixer: press the corresponding function button of the mixer to start the mixer window, and the multi-channel input audio, built-in audio and output audio can be adjusted by touching the touch screen monitor or dragging the mouse band equalization gain, etc.

Multi-camera subtitle broadcast function

The subtitle module of this embodiment can support applications such as title subtitle, scrolling, screen scrolling, station logo, etc., and supports real-time modification of subtitle content. The preview pictures of subtitle shots can be displayed in the list, and multi-camera broadcasting can be performed. Subtitle setting: First, press the function button corresponding to the subtitle setting to start the subtitle setting window, select the subtitle template to be used, and modify the content of the subtitle in real time, and then add the subtitle to the CG window of the subtitle echo window, and multiple subtitles can be added Templates are added to the CG echo window to realize multi-camera subtitles. Finally, through the CG button on the soft switcher, the subtitles are uploaded to the PGM output echo window and the video material is synthesized and output. (All operations support Direct Touch or mouse click)

Live Streaming Publishing Device

This embodiment is provided with an example streaming media encoder and a streaming media publisher, which support real-time streaming media distribution, and use the streaming media server technology to broadcast the program currently being filmed on the Internet. The task of the software in this embodiment is to write the collected streaming media files to the specified location, and clicking the button will trigger the software to publish the streaming media.

10) Application mode of Direct Touch touch screen

This embodiment creatively introduces the touch screen technology into the studio system, and the entire working process of the system can be realized by touch screen operation, which is quite intuitive for operators, and what you see is what you get. The application process of the Direct Touch touch screen: In the interface display area of this embodiment, all input signals, including multiple external signals, background signals, subtitle signals and multiple existing video signals, can be directly touched and dragged by the touch screen display. Drag it to the playback window of the ready-to-broadcast video content or the playback window of the currently-broadcast video content. The function buttons of each function module can also be selected and applied by human touch. All operations are very intuitive and do not require any professional knowledge as a foundation, what you see is what you get.

11) HD/SD compatible device

This embodiment can realize HD/SD mixed production and HD/SD simultaneous input in the multifunctional integrated studio system, and can automatically convert up and down, and output optional HD/SD mode.

The IO plate card that the hardware device of the system described in this embodiment adopts itself possesses HD/SD compatible characteristics, and the software of the system described in this embodiment is designed with a control module before starting, and the signal type of each interface of the IO plate card can be set , so as to realize the mixed editing and output operation of input and output signal HD/SD.

Embodiment two:

This embodiment is an improvement of the first embodiment, and it is a refinement of the first embodiment concerning the external video signal source and the multi-channel input circuit. The external video signal source described in this embodiment is a device that provides SDI, 1394, HDMI and VGA signals, including: video camera, Blu-ray disc video recorder, hard disk video recorder, video server, satellite receiver, tape video recorder, non-linear editing one of the machines. The multi-input circuit includes 6-way SDI recognizers, 4-way 1394 recognizers, 4-way HDMI recognizers, and i-VGA recognizers, and supports recognizing SDI, 1394, HDMI, and i-VGA format inputs.

This embodiment itself is equivalent to a small studio system. Multi-camera shooting is often encountered in the daily work of the studio. This embodiment supports up to 6 Shooting with six cameras. At the same time, high-definition and standard-definition compatible digital IO boards are used, and the rear panel of the host with various video and audio interfaces and control interfaces can support SDI, 1394, HDMI and VGA interface signals, as long as the camera that meets the above interfaces is combined with the camera of this embodiment The rear panel is connected, and all the functions of this embodiment can be used for on-site shooting and production after starting the software module of this embodiment.

The IO board of this embodiment supports the input and output of a plurality of video signals. When the software module of this embodiment coordinates with the board module to process the signal, the input signal received by the board adopts the multimedia clock method to process the signal response. In this way, the frame rate of the corresponding video system can be guaranteed. At the same time, the hardware interrupt function of the board is used to realize the echo and output of the PGM and PVW signals. Each echo screen can be arranged in any combination, and the corresponding input and output signals can be monitored in real time in the multi-screen display area, including camera signals, external signals, existing material signals, subtitle signals, background signals, PGM signals, PVW signals, etc. Each signal echo window in the multi-screen display area can also be output to the large screen through the DVI signal and displayed separately

Embodiment three:

This embodiment is an improvement of the second embodiment, and is a refinement of the tally controller and the tally system on the basis of the second embodiment. The central processing device is connected with a tally controller, and the tally controller is connected with a plurality of tally lamps which are equal to the number of cameras and are respectively connected with the corresponding camera physical devices, and the tally controller is connected with a multi-screen split and a screen signal converter , to display the tally light signal corresponding to the camera and the tally light signal corresponding to the built-in video signal in a corner of the echo window corresponding to the camera or built-in video signal on the split image. The central processing device notifies the TALLY controller of the signal output line, and the TALLY controller displays the TALLY light signal on the corresponding window on the multi-picture split screen of the line status. At the same time, if the line signal is an external camera signal, the tally controller transmits the signal to the tally light on the corresponding camera through the physical line at the same time, and controls it to light up.

The tally light is an indicator light on the camera, which is used to show that the video signal of the camera is being broadcast. TALLY reminder system is an auxiliary system when the video system is working. It plays a very important role in the studio. It can remind the program director, cameraman and technicians of the working status of the studio in time, and at the same time, it can coordinate the director during the program. , cameraman and moderator work. In the multi-picture area of this embodiment, you can see the TALLY light indication. The red light identifies the signal that is currently being output, that is, the signal source of PGM; the green light identifies the signal that is ready to be output, that is, the signal source that identifies the PVW. The tally signal is also provided to the camera.

The tally system of this embodiment is composed of a controller and several tally lamps. The controller can be connected with any switcher, broadcast console, and matrix interface. The connection between the tally lamps is a bus structure, which can be connected in parallel. The twisted-pair cable or ordinary single-core shielded cable is connected. When there is an action to switch signals, the corresponding TALLY light will automatically change color.

Embodiment four:

This embodiment is an improvement of the above embodiment, and is a refinement of the above embodiment regarding the external audio signal source and the mixer device. The external audio signal source is the microphone or audio playback device on each camera; the audio input circuit supports the selection input of 6-way AES/EBU digital audio and 6-way balanced analog audio (the total number is not more than 6), and two built-in Audio input; the mixer device supports the tuning of 8-way audio input signals and the tuning of 2-way audio output signals; the corresponding audio signals are displayed in the form of changing bright bars in the corresponding echo in the multi-screen split area One corner of the window, and control the volume and sound effects through the mixer.

While processing video signals, this embodiment itself integrates the function of a mixer, which can adjust input and output audio signals. In the audio system of the studio, the mixer is the core control equipment. The collection, processing and distribution of various sound sources are completed through the mixer. Generally, the sound is fully controlled on the mixer. This embodiment is embedded with 8 channels of mixer, 6 channels of external audio can be directly connected through the rear panel of this embodiment, and two channels of built-in audio are used to adjust the existing audio materials of this embodiment, and there are also two channels of output Audio adjustment controls. In use, first connect the corresponding sound source to the interface on the rear panel of this embodiment, after starting the software module of this embodiment, click the mixer control icon at the bottom of the interface to open the mixer control interface, so as to realize the sound control Adjustment.

The implementation method of the mixer is: the software adds the externally input audio data obtained through the sound card ASIO driver and the audio data decoded from the existing materials into the ring buffer queue, and adjusts the gain value of each channel according to the gain value set in the mixer interface. The volume is calculated in real time, and then the audio data that has been processed by mixing and output gain is added to the output buffer according to the configured input and output mapping scheme, and then the audio data is output to the sound card through the sound card drive line. When the program is running, the volume indicator dynamically displays the current volume in real time. When the mouse moves to a certain volume indicator, a prompt box will display the current gain value in real time. Thus, the adjustment and monitoring of the audio signal are finally realized.

Embodiment five:

This embodiment is an improvement of the above-mentioned embodiment, and is a refinement of the background device, subtitle device, and existing material playback device of the above-mentioned embodiment. The built-in video input signal source described in this embodiment includes: a background device with a multi-channel background generator and a multi-channel background buffer, a subtitle device with a multi-channel subtitle generator and a multi-channel subtitle buffer, and a subtitle device with a slave memory The multi-channel existing material decoder that extracts and decodes the existing material and the existing material playback device that buffers the existing material; the background video signal generated by the background device, the subtitle video signal generated by the subtitle generator, and the existing material playback device. The existing material video signals played by the output device are respectively displayed in the respective echo windows on the split images.

During broadcasting in the studio, static backgrounds are often used, such as during maintenance of TV stations or during nighttime shutdowns. The background device meets this requirement. First, store the corresponding background pictures in the corresponding storage area of the memory, and then store the data streams corresponding to these pictures in the background buffer of the background device. Finally, through the control command of the central control module, directly Call the corresponding image data in the background buffer to the buffer corresponding to the background preview window for background echo, and finally use the signal switching command to broadcast the background signal through Direct Touch and other methods.

The production of subtitles is also essential in the production of studio programs. This embodiment integrates the function of subtitle production, which is realized by a subtitle editing device. At the bottom of the main interface, there is a subtitle control icon that can be clicked to call the subtitle control module, and there is also a corresponding subtitle preview echo window (CG) in the echo area of the split screen. When using it, click the icon corresponding to the subtitle device to open a shot list, you can see the preview effect of the subtitle shot, select a shot, click play, you can see the effect of the subtitle broadcast in the CG preview window, click the superimposed subtitle button (CG IN/OUT), you can superimpose this subtitle on the output signal (PGM). This embodiment supports separately controlling the playback of multiple subtitle shots, and can simultaneously upload title words, scrolling screens, station logos, and clocks; and also supports real-time modification of subtitle content, and the content can be modified by double-clicking a shot.

In order to ensure the scalability of the system, the system uses socket technology to realize the command communication between the control terminal and the subtitle system, and the communication command is realized in XML format.

The basic format of a command is as follows:

<? xml version = "1.0" encoding = "UTF-16"? >

<ncg version="1.0"

xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance http://www.w3.org/2001/XMLSch

ema-instance xsi:noNamespaceSchemaLocation="ncg.xsd">

<sever>192.168.0.1</sever>

<client>192.168.0.1</client>

<message>100</message>

<play>

<itemid>Flag1</itemid>

<clipid>0</clipid>

<taskid>0</taskid>

</play>

</ncg>

Render data link:

Realize submitting the subtitle system rendering results to the main system for processing.

Because this link involves a large amount of data interaction, shared memory technology is used to realize inter-process communication.

In order to submit rendering data synchronously in real time, the system designs a set of data exchange instructions to ensure that rendering data is submitted correctly in real time.

The specific implementation of the subtitle module is as follows: the present invention provides an independent process subtitle rendering engine, which transmits data and commands through the shared memory, outputs the buffer after subtitle rendering, and provides it to the special effect module for superimposition. Subtitle project files PRJ files contain multiple shots. When the PRJ file is exported, an XML file is generated, which contains the thumbnail information and title word information of each lens. Directly read XML files in the disk directory without going through the resource manager. Show the camera icons included in the XML in the subtitle list. When loading the XML file, read all the title word information, select the lens, and play it in the preview window. When double-clicking, the window becomes the modification mode. After the modification is confirmed, call the CG command to re-render and return to the first frame. Send command and get Buffer (set interrupt) through shared memory. Each shot can be played independently, and the upper subtitle control button in the control panel of the subtitle module records the status for each shot.

The existing material playback of the present invention can support the function of dual-channel playback. In view of the modular design concept, the material selection and playback of the two channels are respectively two independent software modules, so the two channels are completely independent, which is equivalent to Two video recorders in the studio. It can control the playback, pause and stop of the material, and realize the functions of continuous broadcast, breakpoint broadcast, order broadcast, entry and exit point broadcast, and loop broadcast through software design.

Simultaneous playback of two channels of existing material can be used to broadcast titles, trailers, clips, advertisements and other materials. You can customize the broadcast list of materials, and you can add materials to the play list by selecting files. You can adjust the play order, set the in and out points of material broadcast, and support breakpoint playback and continuous playback. You can control the playback stop action of the existing material through the control buttons: play, pause, stop, or automatically trigger the playback stop action of the existing material through the PGM window. Through the existing material control module, open the file dialog box, select the material to be played, add it to the material playlist, and the video decoder and audio decoder will complete the video decoding work and audio decoding work respectively, and the decoder can automatically identify SD material, HD material, and according to the system settings, provide SD and HD signals in YUVU or ARGB format. The material automatically completes the CUE state. When the material is playing, one video signal is provided to the soft switcher, and two audio channels are provided to the mixer. In order to ensure stable broadcasting, material decoding adopts a buffering mechanism, uses token rings, slows down the decoding speed when the CPU utilization rate is at a peak, and speeds up the decoding speed when the CPU utilization rate is low, so as to finally ensure the smoothness of video and audio broadcasting , proceed smoothly.

Embodiment six:

This embodiment is an improvement of the above embodiment, and is a refinement of the control operation analysis unit of the above embodiment. The control operation analysis unit described in this embodiment includes: a background control device, a subtitle control device, an existing material control device, a soft switcher control device, a mixer control device, a special effect control device, a virtual studio control device, a broadcast Signal recording control device.

The control operation analysis unit will issue corresponding control commands after receiving corresponding control commands. The main analytical units are:

Background control device:

During studio broadcasts, static backgrounds are often used. First store the corresponding background pictures in the corresponding storage area of the memory, then store the data streams corresponding to these pictures in the background cache of the background device, and finally call the corresponding picture data in the background cache directly through the control command of the central control module to the cache corresponding to the background preview window for background echo, and finally the signal switching command is used to broadcast the background signal through Direct Touch and other methods.

Subtitle Control Device:

The subtitle control module can support title subtitle, scrolling, scrolling, station logo and other applications, and supports real-time modification of subtitle content. The preview pictures of subtitle shots can be displayed in the list, and multi-camera broadcasting can be performed. Subtitle setting: First, press the function button corresponding to the subtitle setting to start the subtitle setting window, select the subtitle template to be used, and modify the content of the subtitle in real time, and then add the subtitle to the CG window of the subtitle echo window, and multiple subtitles can be added Templates are added to the CG echo window to realize multi-camera subtitles. Finally, through the CG button on the soft switcher, the subtitles are uploaded to the PGM output echo window and the video material is synthesized and output. (All operations support Direct Touch or mouse click)

Existing Material Controls:

The existing material control device is the existing material playback device, which can support the function of dual-channel playback. In view of the modular design concept, the material selection and playback of the two channels are two independent software modules, so the two channels Completely independent, it is equivalent to two playback cameras in the studio. It can control the playback, pause and stop of the material, and realize the functions of continuous broadcast, breakpoint broadcast, order broadcast, entry and exit point broadcast, and loop broadcast through software design.

Soft switcher control device, special effect control device:

The present invention realizes the function of the traditional switcher through software design. This part of the software includes a special effect production module, which supports various common switching special effects, including fade in and fade out, wipe, picture in picture, three-dimensional special effects, etc. It is realized by adding the corresponding special effect algorithm to the image files stored in the buffer, so when switching video signal A to video signal B, first copy the video signal A in the input buffer to the output buffer, and then copy the video signal A in the input buffer to the output buffer. After video signal A and video signal B in the output buffer are superimposed and processed, they are copied to the output buffer, and the superimposed operation selects the corresponding algorithm of the corresponding special effect, and the video signal B in the input buffer is copied to the output buffer to complete A to B The switching of video signals with special effects can realize the production of new special effects by changing the special effect superposition algorithm, that is, calling, so as to realize the expansion of the special effect form. To switch signals, first select the output signal of the PVW window and the PGM window by Direct Touch or mouse click, then select the function button corresponding to the effect, open the effect selection window and select the effect template to be applied, and then select the effect template to be applied on the soft switcher through T The stick can realize manual stunt switching, or touch and press (mouse click) the AUTO button to realize automatic stunt switching, and can also realize non-stunt switching through the CUT button.

Mixer controls:

This embodiment has a built-in multi-channel mixer for the setting and adjustment of studio sound. Setting and operation of the mixer: Press the corresponding function button of the mixer to start the mixer window, and the size of multiple input audio, built-in audio and output audio can be adjusted by touching the touch screen monitor or dragging the mouse. The software adds the externally input audio data obtained through the sound card ASIO driver and the audio data decoded from existing materials into the ring buffer queue, and calculates the volume of each channel in real time according to the gain value set in the mixer interface, and then according to The configured input-output mapping scheme adds the audio data processed by audio mixing and output gain to the output buffer, and then outputs the audio data to the sound card through the sound card drive line. When the program is running, the volume indicator dynamically displays the current volume in real time. When the mouse moves to a certain volume indicator, a prompt box will display the current gain value in real time. Thus, the adjustment and monitoring of the audio signal are finally realized.

Virtual Studio Control Unit:

The virtual studio function of the present invention supports (DV, HDV/DVCAM, DVCPRO) input and output, and can perform high-performance real-time chroma key processing on signals. The foreground signal containing the blue screen background picked up by the camera is sent to the chroma keyer in the virtual studio system, and synthesized with the graphic background signal output by the computer to form the final synthetic signal of the virtual studio system, which can realize the occlusion and crossing of virtual objects and foreground . The implementation method is as follows: After the video screen shot with blue screen or green screen and the set background screen are pushed into the special effect processing queue, the blue screen or green screen is removed by chroma key image method and synthesized with the background screen. The picture is now ready for output. The background picture can be set as a picture or a video picture.

Broadcast signal recording control device:

This embodiment provides a multi-channel recording function. The echo window of each external signal and the interface of the PGM echo window are provided with buttons for recording and stopping recording. The mode of touching the touch screen display can be directly clicked to start recording or stop. Recording (mouse click also works). Supports real-time recording of the main output signal, supports independent acquisition and recording of each input signal, supports commonly used video and audio formats, can customize the recording format, supports dual-channel acquisition, and saves the acquired materials in file format, which is convenient for later editing use. When you want to record a signal, just click the record button on the corresponding screen to record it. The specific implementation method is: the video signal and audio signal to be recorded pass through the video encoder and audio encoder, and according to the system configuration of this embodiment, the material in the preset acquisition format is generated. In the signal recording process, the buffer mechanism is adopted, and the token ring is used to slow down the encoding speed when the CPU usage is high, and to speed up the encoding speed when the CPU usage is low, thus finally ensuring the smooth and stable recording of video and audio signals.

Embodiment seven:

This embodiment is an improvement of the above embodiment, and is a refinement of the screen segmentation of the segmented image in the above embodiment, as shown in FIGS. 2 , 3 , and 4 . In this embodiment, in the screen split display area of the split image, the displayed window types include: the video and audio content echo window that is being played, the video and audio content echo window that is ready to be broadcast, and the contents of various external video and audio signal sources. The echo window, the content echo window of each built-in video and audio input signal source, and the display window of each control device; the content echo window of each built-in video and audio input signal source includes: background content echo window, subtitle preview content echo Window, playback window of existing material playback content. The display windows of each control device include: a virtual studio control window, a background control window, a special effect control window, an existing material playback control window, a subtitle control window, a mixer control window, and a soft switcher control window.

FIG. 2 is a schematic diagram of a screen division of a divided image in this embodiment, wherein each control function button is in a closed state. In the screen split display area of the split image, the types of windows displayed include: the video content echo window being broadcast or the main output PGM echo window, the video content echo window ready to broadcast or the preview output PVW echo window Window, the content echo window of each external video signal source, the content echo window of each built-in video input signal source, and various control buttons, including: virtual studio control button, background control button, existing material playback button, special effect control Window buttons, subtitle control buttons, mixer control buttons, soft switcher control buttons. Each corresponding echo window can be entered through these buttons. The echo windows corresponding to each channel include: virtual studio control window, background content echo window, existing material playback echo window, special effect control window, subtitle preview echo window, mixer control window, soft switcher control window . Figure 3 shows the expansion of the special effect control window and the soft switcher control window, and the expansion diagrams of other buttons can be taken as an example.

Embodiment eight:

This embodiment is a multi-functional integrated presentation method using the system described in the above embodiments. The steps of the method described in this embodiment are as follows:

Steps to collect images: If the external video signal source is a video camera, use the video camera to convert the scene into an electronic image. If the external video signal source is a device that provides SDI, 1394, HDMI and VGA signals, including: video camera, Blu-ray disc recorder, hard disk One of the video recorders, video servers, satellite receivers, tape video recorders, and non-linear editing machines directly obtains video signals and audio signals.

Format recognition steps: If the external video signal source is a camera, it is used to identify whether the format of the image output by the camera is digital or analog, and if it is digital, it must be identified as one of SDI, 1394, HDMI, and VGA. If the external video signal source is one of Blu-ray disc player, hard disk player, and video server, it must also be identified as the one among SDI, 1394, HDMI, and VGA.

Simultaneously with the above-mentioned collecting video and audio signal source input step and format identification step is the step of obtaining subtitles, existing material, background and virtual studio scene from the built-in video input signal source, that is: the step of generating subtitles by the subtitle device, from the existing There are steps of obtaining existing materials from the material storage, steps of obtaining the background from the background device, and steps of generating a virtual studio scene by the virtual studio device;

Steps to generate subtitles in the subtitle device:

The subtitle device contains a subtitle editing device, a subtitle memory, a subtitle generator and a subtitle cache, and the subtitle editing device first performs the production work of a subtitle template and a subtitle content, and the described subtitle editing device is connected with the subtitle memory, and in the subtitle device A subtitle generator is included, and the subtitle generator obtains the prepared subtitle template and subtitle content from the subtitle memory to generate subtitles, and the subtitle generator is connected with the subtitle buffer, and sends the generated subtitle signal into the subtitle buffer.

Steps to get the existing material from the existing material memory:

The existing material playback device contains an existing material storage, an existing material decoder, and an existing material cache, the existing material storage is connected to the existing material decoder, and the existing material decoder is connected to the existing material cache . The existing material decoder decodes the existing material in the existing material storage, and sends the decoded video content into the existing material cache, so as to complete the acquisition of the existing material.

Steps to get background from background device:

The background device includes a background memory and a background cache, and the background cache acquires background picture files from the background memory.

Steps for virtual studio device to generate virtual studio scene:

The virtual studio device includes a virtual scene making device, a virtual scene storage, a virtual scene generator and a virtual scene cache. The virtual scene making device is connected with the virtual scene storage, the virtual scene storage is connected with the virtual scene generator, and the virtual scene generator is connected with the virtual scene cache. The virtual scene making device sends the created scene into the virtual scene storage, and the virtual scene generator obtains the scene from the virtual scene storage and generates a virtual scene, and finally sends it into the virtual scene cache.

The step of inputting the cache: it is used to enter the collected video signal and audio signal or the subtitle edited by the subtitle device or the existing material taken out from the memory into the cache and update it synchronously.

The processing steps of the central processing device: it is used to select the video signal and audio signal in each input buffer, and superimpose and synthesize the broadcast image composed of subtitles and sound effects, which can be achieved by operating the mouse, keyboard or touch screen display Direct Touch is used to switch between various video signals. The switching process allows the use of fade-in and fade-out, wipe, picture-in-picture, 3D special effects, or virtual background processing, as well as HD/SD conversion.

It is a feature of this embodiment to perform control operations in the manner of Direct Touch. In most cases, studio personnel are still used to working with various discrete hardware. In this embodiment, this Direct Touch method is creatively applied to various controls in the studio, making the control more intuitive and convenient, and realizing that various soft controls are integrated on a touch screen, and using the Direct Touch method in the studio What you see is what you get when the signal is switched, and the corresponding function can be called directly by clicking and dragging, avoiding some misoperations during traditional operations.

The step of output buffering: it is used to input the video signal and audio signal of each channel, as well as the edited video signal and audio signal into the buffer and update them synchronously.

The video and audio signals output from the output buffer are divided into four channels.

The first way: the step of multi-picture division: it is used to gather multiple input video signals and output video signals in one picture and divide the picture to assign the position of each video signal in the picture.

Display steps: the large-screen display and the touch-screen display use split images to display various input video signals, audio signals, output video signals, and output audio signals, as well as the control windows of each control device, including: virtual studio control buttons and expanded The control window after the background device, the control button of the background device and the control window after expansion, the control button of the existing material playback device and the control window after expansion, the control button of the special effect device and the control window after expansion, the control button of the subtitle device and the control window after expansion The control window of the control window, the control button of the mixer device and the expanded control window, the control window of the soft switcher control device, and monitor the control operations of each control device in the entire display area at the same time.

The steps of the feedback command: control the operation by operating the mouse, keyboard or Direct Touch of the touch screen. Through the mouse, keyboard or direct touch of the touch screen display, perform various command operations, such as dragging, clicking, and releasing, and then realize such as: adjusting volume and sound quality, subtitle setting and operation, adding background or various existing materials, making Broadcasts with virtual backgrounds and more.

The Direct Touch method obtains the corresponding control operation through the touch screen, and recognizes the operation mode corresponding to the corresponding control operation through the touch screen sensing device, such as dragging, clicking, and releasing; then the touch screen receives the operation according to the corresponding area and position Call the corresponding control commands and related functions of the area or position, such as signal switching, special effect superposition, mixer control, subtitle superimposition, existing material playback, virtual studio setting, background setting and other operations; so as to realize touch screen The monitor controls the entire broadcast process.

The second way: the step of encoding the broadcast signal: used to encode the broadcast signal to form a program file;

The step of storing the broadcast signal encoding file: storing the program file formed after the broadcast signal encoding in the memory;

The third way: the step of broadcast signal streaming media processing: while storing the program files, perform streaming media encoding processing on the programs in the output buffer;

The step of broadcasting program streaming media files into the network: outputting the streaming media program files processed by streaming media encoding to the computer network;

The fourth channel: the step of broadcasting signal output: it is used to send the output video signal and audio signal in the output buffer to the TV network for broadcasting through the output circuit.

Simultaneously with the processing steps of the above-mentioned central processing device and the steps of output buffering and broadcasting, external signals are recorded. This step includes: the steps of encoding the external signals and the steps of storing the encoded files of the external signals:

The step of encoding the external signal: the video acquisition buffer and the mixer device are connected to the acquisition and recording encoder, and are used to complete the encoding of the video content and audio content of the external signal to form an external signal encoding file.

The step of storing the encoded file of the external signal: the acquisition and recording encoder is connected to the memory, and the file generated after encoding the external signal is sent into the memory to complete the recording of the external signal.

It can be seen from this embodiment that the present invention supports the realization of all-digital switching control and broadcasting of multi-channel signals in the studio through computer processing. Real-time collection and collection of live signal sources, and the collected files are stored to support subsequent further production. This plays a direct role in material collection and program synthesis for the documented and digitalized TV live broadcast process, and solves the problem of the original analog studio and digitalization. The problem of disjointed production and broadcasting systems.

Embodiment nine:

This embodiment is an improvement of the eighth embodiment, and it is a refinement of the control operation of the touch screen display described in the eighth embodiment through Direct Touch. The Direct Touch mode of the touch screen display described in the present embodiment carries out control operation sub-step as follows:

Identify the position of the human hand on the touch screen of the touch screen display to determine the function corresponding to the corresponding area and position of the touch screen;

The touch screen acquires the corresponding control operation, and recognizes the operation mode corresponding to the corresponding control operation through the touch screen sensing device, such as dragging, clicking, and releasing;

According to the operation mode of the corresponding area and position, the touch screen calls the corresponding control command and related functions of the area or position, such as signal switching, special effect superposition, mixer control, subtitle superposition, existing material playback, virtual studio Room setting, background setting and other operations, so as to realize the control of the whole studio process by the touch screen display.

This embodiment is a mode similar to mouse and keyboard control and computer operation, but the operation is more intuitive and simpler. The way to use the Direct Touch of the touch screen display is to turn the action of the human hand on the touch screen display into a control signal. First, identify the position of the human hand on the touch screen of the touch screen display to determine the corresponding function of the corresponding area and position of the touch screen; the touch screen acquires the corresponding control operation, and recognizes the corresponding operation mode of the corresponding control operation through the touch screen sensing device, such as Drag, click, release; the touch screen invokes the control commands and related functions corresponding to the area or position according to the operation mode of the corresponding area and position, such as signal switching, special effect superposition, mixer control, subtitle superposition, There are operations such as material playback, virtual studio setting, background setting, etc., so as to realize the control of the whole studio process by the touch screen display.

Embodiment ten:

This embodiment is an improvement of the eighth embodiment, and is a refinement of the eighth embodiment on the switching of the direct touch mode of the touch screen display and the switching special effects. The sub-steps of switching between various video signals in the Direct Touch mode of the touch screen display described in the present embodiment are as follows:

Recognize the position of the human hand on the touch screen of the touch screen display to determine which video signal is selected.

Add a green frame to the echo window field of the selected video signal to show that the video signal is selected.

Recognize the sliding of the human hand on the touch screen display to determine whether to drag the selected video signal to the ready-to-play area, and if the hand is released in the ready-to-play area, then confirm that the selected video signal is placed in the ready-to-play area The video signal is switched to the ready-to-play area.

Select the type of switching effect: Fade, Wipe, PIP, 3D effect type.

Using the selected special effect type to switch the video image of the ready-to-broadcast area and the video image of the currently-broadcast area includes the following sub-steps:

Copy the video image of the ready-to-play area in the input buffer to the output buffer.

Copy the video image of the ready-to-broadcast area in the input buffer and the video image of the playing area in the output buffer to the output buffer after superposition operation processing. The superposition operation can be fading, wipe, picture-in-picture, 3D One of.

The video image of the playing area in the input buffer is copied to the output buffer, thereby completing the switching from the video image of the ready-to-play area to the video image of the playing area.

After the echo of the input and output signals is realized on the split screen, this embodiment supports the signal switching from each input signal to the output signal. First, the output signal of the PVW window and the PGM window are selected, and the signal of the PVW window can be switched by switching the function key. Switch to the PGM output window, here you can first connect each input signal to the PVW window according to the traditional workflow, and then switch to the PGM window, or you can directly input the input signal by dragging the mouse or using the Direct Touch method described in this embodiment. Drag the signal to the PGM window to realize signal output. The main technology used in this link is: the software first obtains the video signal, and stores it in the circular input buffer queue by frame, locks the main output and preview output indicator during the process of taking out the frame for output, and then unlocks it after completion. In this way, the timing when switching the output signal is guaranteed, the switching process from input to output of the signal is realized, and at the same time, the problem of image jitter that may be caused by the switching is avoided.

For the switching process of the signal from the PVW window to the PGM window, this embodiment supports signal trick switching. After selecting the output signal of the PVW outlet, open the special effect selection window to select the special effect template to be applied, and then realize manual special effect switching through the T-bar on the soft switcher, or touch and press (mouse click) the AUTO button to realize automatic special effects switch.

The realization of the stunt device mainly includes three parts technically: 1) the signal source module. 2) Special effect rendering module. 3) Output module. Its operation mode is: the central processing unit pushes signals to the special effect rendering module within a fixed (or non-fixed) time interval (the average time is equal to the signal unit time), and the special effect rendering module queues the input signals and notifies the signal source module . After the signal source module finds that there is a signal to be processed, it takes out a signal for input processing, and then pushes the processed signal into the rendering module queue, and notifies the rendering module. Then perform (or wait for) the next task processing. At the same time, after the rendering module finds that there is a signal to be processed, it takes out a signal and performs special processing, and then pushes it into the output module queue, and notifies the output module, and then proceeds (or waits) for the next task processing. When the output module finds that there is a signal to be processed, it outputs the signal and returns the final signal to the external module, and then performs (or waits for) the next task processing.

In this way, this embodiment finally uses the pipeline method to push the picture and special effect parameters that need to be processed for each frame into the processing queue of the special effect module, and the special effect device pops up the processed frame, and puts the frame into the output buffer through the callback function, and the IO The hardware interrupt of the board triggers the call of the output function, and finally realizes the stunt switching function.

Finally, it should be noted that the above is only used to illustrate the technical solution of the present invention without limitation, although the present invention has been described in detail with reference to the preferred arrangement scheme, those of ordinary skill in the art should understand that the technical solution of the present invention (such as functions, arrangements of devices, units, operation process of steps, etc.) or equivalent replacements, without departing from the spirit and scope of the technical solution of the present invention.

Claims (10)

1. multifunctional all studio system, described system comprises: a computer that has mouse and keyboard that is connected with external audio signal source with external video signal source, it is characterized in that, be provided with the multi-channel video input circuit that is connected with described external video signal source in the described computer, described multi-channel video input circuit is independently gathered the multi-channel video collection buffer memory of recording with support respectively to every road input signal and is connected, described multi-channel video collection buffer memory is recorded encoder with multi pass acquisition and is connected, and described multi pass acquisition is recorded encoder and is connected with memory; Be provided with the multichannel voice frequency input circuit that is connected with described external audio signal source in the described computer, described multichannel voice frequency input circuit is independently gathered the multichannel voice frequency collection buffer memory of recording with support respectively to every road input signal and is connected; Also be provided with multichannel voice frequency material source in the described computer, described multichannel voice frequency material source links to each other with the multichannel voice frequency decoder, described multichannel voice frequency decoder is connected with multichannel voice frequency material source cache, and described multichannel voice frequency is gathered buffer memory, multichannel voice frequency material source cache is connected with the sound console device; Also be provided with built-in video input signals source in the described computer; Described computer also is provided with the virtual background device; Described computer also is provided with the control operation resolution unit that is connected with touch-screen display and external cut bank and described mouse, keyboard, and described control operation resolution unit is connected with function control resolution unit; Described video acquisition buffer memory, sound console device, built-in video input signals source, function control resolution unit are connected with central processing unit; Described central processing unit is connected with output buffers, many picture segmentation and screen signal transducer; Described output buffers is recorded encoder with screen signal transducer, output circuit, real time flow medium encoder, support to the broadcast of the real-time recording of main output signal with many picture segmentation and is connected; Described many picture segmentation and screen signal transducer and large screen display and stereo set, described touch-screen display are connected; Described output circuit is connected with the television network of exporting as broadcast; Described real time flow medium encoder is connected with the Streaming Media distributor, and the Streaming Media distributor is connected with the computer network of exporting as network; Described broadcast is recorded encoder and is connected with memory.

2. system according to claim 1, it is characterized in that, described external video signal source provides the equipment of SDI, 1394, HDMI and VGA signal, comprising: a kind of in video camera, Blu-ray disc videocorder, hard disk videocorder, video server, satellite receiver, magnetic tape record/play camera, the non-linear editing computer; Described multichannel input circuit comprises 6 road SDI identifiers, 4 tunnel 1394 identifiers, 4 road HDMI identifiers, i-VGA identifier, supports identification SDI, 1394, HDMI, the input of i-VGA interface.

3. system according to claim 2, it is characterized in that, described central processing unit is connected with the TALLY controller, described TALLY controller is connected with a plurality of TALLY lamps that equate with number of cameras and install respectively on corresponding video camera, described TALLY controller is connected with the screen signal transducer with many picture segmentation, and the TALLY modulating signal of representative TALLY modulating signal of corresponding video camera and corresponding built-in vision signal is presented in video camera or the display window of built-in vision signal correspondence on split image one jiao.

4. according to claim 1 or 2 or 3 described systems, it is characterized in that described external audio signal source is microphone or the audio-frequence playback equipment on each video camera; The audio frequency input circuit is supported the selection input of 6 road AES/EBU digital audio and 6 road balance simulation audio frequency, the input of two path built-in audio frequency; Described sound console device is supported the tuning of 8 road audio input signals, the tuning of 2 road audio output signals; Pairing audio signal is presented at a jiao in the corresponding display window in many picture segmentation zone with the form of change bright wisp, and can control volume, audio by sound console.

5. system according to claim 4, it is characterized in that, comprise: the Background apparatus that has multichannel background maker and multichannel background buffer memory in described built-in video input signals source, having virtual scene makes, the virtual scene storage, the virtual scene maker, the virtual studio device of virtual scene buffer memory, have multichannel caption editing device, the captions memory, the captions device of caption generator and multichannel captions buffer memory, the existing material broadcast device that has existing material decoder of the multichannel of from memory, extracting existing material and decoding and the existing material buffer memory of multichannel; The existing material vision signal that the captions vision signal that the virtual studio vision signal that the background video signal that Background apparatus generates, virtual studio device generate, caption generator generate, existing material broadcast device broadcast is presented at respectively on the split image in separately the display window.

6. system according to claim 5, it is characterized in that, comprise in described control operation resolution unit: background control device, caption control device, existing material control device, soft handover platform control device, sound console control device, stunt control device, virtual studio control device, broadcasting signal are recorded control device.

7. system according to claim 6, it is characterized in that, in the picture segmentation viewing area of described split image, shown window type comprises: broadcasting and looking the audio content display window, prepare to broadcast and to look audio content display window, each road external video/audio signal source contents display window, each path built-in and look audio input signal source contents display window, each control device display window; Described each path built-in is looked audio input signal source contents display window and is comprised: background content display window, caption preview content display window, existing material play content display window, virtual studio content display window; Described each control device display window comprises: virtual studio control window, background control window, stunt control window, existing material Play Control window, captions control window, sound console control window, soft handover platform control window.

8. one kind is used the multifunctional all of the described system of claim 1 to perform in a radio or TV programme method, it is characterized in that the step of described method is as follows:

The step of images acquired and sound: if external video/audio signal source is video camera then is used for video camera and changes scenery into electronic image signal and electronic voice signal, if external video/audio signal source provides the equipment of SDI, 1394, HDMI and VGA signal, comprising: a kind of vision signal and the audio signal then directly obtained in video camera, Blu-ray disc videocorder, hard disk videocorder, video server, satellite receiver, magnetic tape record/play camera, the non-linear editing computer;

The step of format identification:

Form that if external video signal source is a video camera then be used to discerns the picture signal of video camera output be numeral or simulation, if also will discerning of numeral is any among SDI, 1394, HDMI, the VGA;

If external video signal source is a kind of in Blu-ray disc player, hard disk player, the video server, the form that will discern the picture signal of external video signal source output equally is any among SDI, 1394, HDMI, the VGA;

What carry out simultaneously with above-mentioned collection video/audio signal source input step and format identification step is the step of obtaining captions, existing material, background and virtual studio scene from built-in video input signals source, that is: the captions device generate captions step, obtain the step that the step of existing material, the step of obtaining background from Background apparatus, virtual studio device generate the virtual studio scene from existing material memory;

Generate the step of captions in the captions device:

Contain caption editing device, captions memory, caption generator and captions buffer memory in the captions device, described caption editing device at first carries out the making work of subtitle template and caption content, described caption editing device links to each other with the captions memory, contain caption generator in the described captions device, described caption generator obtains subtitle template and the caption content made and carries out the captions generation from described captions memory, described caption generator links to each other with the captions buffer memory, and the caption signal that generates is sent in the captions buffer memory.

Obtain the step of existing material from existing material memory:

Contain existing material memory, existing material decoder, existing material buffer memory in the existing material playing device, described existing material memory links to each other with existing material decoder, and described existing material decoder links to each other with existing material buffer memory.The existing material that described existing material decoder will have in the material memory is decoded, and decoded video content is sent in the existing material buffer memory, finishes obtaining of existing material.

From Background apparatus, obtain the step of background:

Contain background memory and background buffer memory in the described Background apparatus, described background buffer memory obtains the background picture file from background memory.

The virtual studio device generates the step of virtual studio scene:

Described virtual studio device contains virtual scene producing device, virtual scene storage, virtual scene maker and virtual scene buffer memory.Described virtual scene producing device links to each other with the virtual scene storage, and described virtual scene storage links to each other with the virtual scene maker, and described virtual scene maker links to each other with the virtual scene buffer memory.Described virtual scene producing device is sent into the scene of making in the virtual scene storage, and described virtual scene maker obtains this scene and generates virtual scene from the virtual scene storage, finally sends in the virtual scene buffer memory.

The step of input-buffer: the virtual scene that is used for the video/audio signal that will gather, the caption content of captions maker generation, the background picture content of Background apparatus, the existing material that obtains, the generation of virtual scene maker from existing material decoder is sent into buffer memory and renewal synchronously;

The step that central processing unit is handled: be used for the vision signal audio signal of each road input buffer is selected, and the broadcast image that captions, acoustics are formed on superposeing, synthesizing, can between each road vision signal, switch by the mode of Direct Touch of operation mouse, keyboard or touch-screen display, the process of switching allows to use special effects to switch, described special effects is: be fade-in fade-out, draw picture, picture-in-picture, three-dimensional stunt switching effect, or carry out virtual background and handle, and HD/SD conversion;

The step of output buffers: be used for vision signal and audio signal, and vision signal, audio signal that editor finishes enter buffer memory and renewal synchronously with each road input;

Be divided into four the tunnel from the video-audio signal of output buffers output;

The first via: the step of split image: be used for that multichannel incoming video signal and outputting video signal are concentrated on a picture and divided frame distributes each road vision signal position in picture;

The step that shows: utilize the image of cutting apart to show each road incoming video signal in large screen display and the touch-screen display, audio signal and outputting video signal and output audio signal, and the control window of each control device, comprise: the control window after virtual studio control button and the expansion, control window after the control button of Background apparatus and the expansion, control window after the control button of existing material playing device and the expansion, control window after effect machine control button and the expansion, control window after captions device control button and the expansion, control window after sound console device control button and the expansion, the control window of soft handover platform control device, the while supervises the control operation of each control device in whole viewing area;

The step of feedback command: the mode of Direct Touch by operation mouse, keyboard or touch-screen display is carried out control operation, thereby realizes whole control of performing in a radio or TV programme process;

Wherein at first get access to control corresponding operation in the mode of Direct Touch, and identify control corresponding by the touch screen induction device and operate pairing mode of operation by touch-screen, as drag, click, release etc.Touch-screen calls pairing control command in this zone or position and correlation function thereof according to the suffered mode of operation in zone and position of correspondence then, as to operations such as signal switching, stunt stack, sound console control, subtitle superposition, existing material broadcast, virtual studio setting, background are provided with.Thereby realize that touch-screen display is to whole control of performing in a radio or TV programme process.

The second the tunnel: the step of broadcasting signal coding: be used for broadcasting signal is encoded, form program file;

The step that the broadcasting signal coded file stores: the program file that broadcasting signal coding back is formed is stored in the memory;

Third Road: the step that the broadcasting signal Streaming Media is handled: in the programs stored file, the program in the output buffers is carried out the Streaming Media encoding process;

The broadcast items files in stream media enters the step of network: will export computer network to through the flow-medium performance file of Streaming Media encoding process;

The the four the tunnel: the step of broadcasting signal output: be used for the outputting video signal and the audio signal of output buffers are sent into the television network broadcast by output circuit.

Step and the output buffers of handling with above-mentioned central processing unit and broadcast that step carries out simultaneously be: extraneous signal is recorded, and this step comprises: the step that the step of extraneous signal coding and extraneous signal coded file store:

The step of extraneous signal coding: described video acquisition buffer memory, sound console device are recorded encoder with collection and are linked to each other, and are used to finish the video content and the audio content coding formation extraneous signal coded file of extraneous signal.

The step that the extraneous signal coded file stores: described collection is recorded encoder and is linked to each other with memory, and the file that extraneous signal coding back generates is sent in the memory, finishes recording at extraneous signal.

9. method according to claim 8 is characterized in that, it is as follows that the mode of the Direct Touch of described touch-screen display is carried out the substep of control operation:

The position of identification staff on the touch-screen of touch-screen display is to determine touch-screen respective regions and the pairing function in position;

Touch-screen gets access to the control corresponding operation, and identifies control corresponding by the touch screen induction device and operate pairing mode of operation, as drags, clicks, discharges;

Touch-screen calls pairing control command in this zone or position and correlation function thereof according to the suffered mode of operation in zone and position of correspondence, as to operations such as signal switching, stunt stack, sound console control, subtitle superposition, existing material broadcasts, virtual studio setting, background are provided with, thereby the realization touch-screen display is to whole control of performing in a radio or TV programme process.

10. method according to claim 8 is characterized in that, the substep that the mode of the Direct Touch of described touch-screen display is switched between each road vision signal is as follows:

The position of identification staff on the touch-screen of touch-screen display, selected to determine which vision signal;

On the display window territory of selected vision signal, add green frame, selected to show this road vision signal;

The slip of identification staff on touch-screen display, prepare to broadcast the district to determine whether that the vision signal that will choose is dragged to, if staff discharges then confirms that the vision signal that will choose is placed on and prepare to broadcast the district prepare broadcasting the district, and this road vision signal switched to prepare to broadcast the district;

Select to switch the type of stunt: be fade-in fade-out, draw picture, picture-in-picture, three-dimensional stunt type;

The stunt type that use is chosen will be prepared to broadcast the video image in district and comprise step by step following with the process that the video image that broadcasts the district switches:

The video image that preparation in the input-buffer is broadcasted the district copies in the output buffers;

After preparation in the input-buffer being broadcasted the video image and the video image stack calculation process of broadcasting the district in the output buffers in district, copy in the output buffers, the stack computing can be to be fade-in fade-out, to draw a kind of in picture, picture-in-picture, the three-dimensional;

The video image that broadcasts the district in the input-buffer is copied in the output buffers, prepare to broadcast the video image in district to the switching of broadcasting the video image in district thereby finish.

Images