A Research on Synchronous Transmission for Audio and Video Based on FFMPEG

Zeng Bi; Zhang Yu

doi:10.12052/gdutxb.160040

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

A Research on Synchronous Transmission for Audio and Video Based on FFMPEG

更新时间：2026-05-27

- A Research on Synchronous Transmission for Audio and Video Based on FFMPEG
- Vol. 34, Issue 4, Pages: 58-64(2017)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.160040
  CLC： TP37
- Online First：09 July 2017，
  
  Published：2017
- 稿件说明：
移动端阅览
曾碧, 张宇. 一种基于FFMPEG的音视频同步算法[J]. 广东工业大学学报, 2017, 34(4): 58-64.

Zeng Bi, Zhang Yu. A Research on Synchronous Transmission for Audio and Video Based on FFMPEG[J]. 2017, 34(4): 58-64.
曾碧, 张宇. 一种基于FFMPEG的音视频同步算法[J]. 广东工业大学学报, 2017, 34(4): 58-64. DOI： 10.12052/gdutxb.160040.

Zeng Bi, Zhang Yu. A Research on Synchronous Transmission for Audio and Video Based on FFMPEG[J]. 2017, 34(4): 58-64. DOI： 10.12052/gdutxb.160040.

摘要

在视频监控系统中，音视频的同步传输是一个非常关键的问题.由于音视频数据量大小的差异以及网络状况的不同，使得在其采集、传输、编解码的过程中，存在失同步的可能.针对这些缺陷，提出一种利用时间戳将采集时间存在相关性的音频和视频数据存入一个固定的同步数据结构中，并在采集、编码、传输、接收、解码以及播放过程中始终加以同步控制.最后将FFMPEG移植到Android平台对该算法进行实验，结果表明，该同步算法具有较稳定的同步效果，能够很好地满足应用场景下的音视频同步需求，同时对Android平台的音视频处理提出了新方法，具有很好的工程实践意义.

Abstract

In video-monitor system

the synchronous transmission of audio and video is a key issue. The audio and video being out of synchronization was caused by the difference among the size of audio data and video data in the procedure of capturing

transmitting and encoding. To solve these problems

a solution is proposed which defines a data structure to store the time-related frames of audio and video data and control the synchronization of audio and video data through all the procedure. At last

the FFMPEG project is ported to Android device to do the experiment. It turns out that the algorithm proposed in this research has a good effect of synchronization. It can meet the need of synchronization in the specified scenes. At the same time

the new method of audio and video processing of Android platform is proposed

which is of great significance in engineering practice.

关键词

Keywords

references

柴若楠, 曾文献, 张鹏云. 音视频同步技术综述[J]. 计算机系统应用, 2011, 20(11): 223-226CHAI R N, ZENG W X, ZHANG P Y. Survey on audio and video synchronization [J]. Computer Systems & Applications, 2011, 20(11): 223-226

RADHAKRISHNAN R, TERRY K, BAUER C. Audio and video signatures for synchronization [C]// Multimedia and Expo, 2008 IEEE International Conference on. Hanover: IEEE, 2008: 1549-1552.

ESCOBAR J, DEUTSCH D, PATRIDGE C. Flow synchronization protocol [C]//Global Telecommunications Conference, 1992. Conference Record. GLOBECOM'92. Communication for Global Users., IEEE. Orlando, FL: IEEE, 1992: 111-121.

RANGAN P V, RAMANATHAN S, VIN H M, et al. Techniques for multimedia synchronization in network file systems [J]. Computer Communications, 1993, 16(3): 168-176.

KUO C C, CHEN M S, CHEN J C. An adaptive transmission scheme for audio and video synchronization based on real-time transport protocol [C]//Multimedia and Expo, 2001. ICME 2001. IEEE International Conference on. Tokyo, Japan: IEEE, 2001: 403-406.

ZHANG J F, LI Y, WEI Y N. Using timestamp to realize audio-video synchronization in real-time streaming media transmission [C]//Proceedings of the2008 IEEE International Conference on Audio, Language and Image Processing. Shanghai: IEEE Press, 2008: 1073-1076.

PALACHARLA S, KARMOUCH A, MAHMOUD S A. Design and implementation of a real-time multimedia presentation system using RTP [C]//2012 IEEE 36th Annual Computer Software and Applications Conference. IEEE Computer Society, 1997: 376-381.

AGGARWAL S, JINDALA. Comprehensive overview of various lip synchronization techniques [C]. Proceedings of the2008 IEEE International Symposium on Biometrics and Security Technologies. Washington, DC: IEEE Press, 2008: 1-6.

曾碧, 林建浩, 肖红, 等. 基于可变码长的音视频同步编码改进算法[J]. 计算机应用. 2014, 34(5): 1467-1472.ZENG B, LIN J H, XIAO H, et al. Improved algorithm of audio-video synchronization coding based on variable code length [J]. Journal of Computer Science. 2014, 34(5): 1467-1472.

李晓妮, 陈贺新, 陈绵书, 等. 基于H.264运动估计的音视频同步编码技术[J]. 吉林大学学报(工学版), 2012, 42(5): 1321-1326.LI X N, CHEN H X, CHEN M S, et al. Audio-video synchronous coding based on motion estimation in H.264[J]. Journal of Jilin University (Engineering and Technology Edition), 2012, 42(5): 1321-1326.

温洁嫦. 数字音频信号的水印隐藏与嵌入算法[J]. 广东工业大学学报, 2008, 25(3): 51-54.WEN J C. Hidden and embedded water marking algorithm for digital audio signals [J]. Journal of Guangdong University of Technology, 2008, 25(3): 51-54.

ITU-R BT. 1359-1. Relative timing of sound and vision for broadcasting [S]. 1998.

刘丽霞, 边金松, 张琍, 等. 基于FFMPEG解码的音视频同步实现[J]. 计算机工程与设计. 2013, 34(6): 2087-2092LIU L X, BIAN J S, ZHANG L, et al. Synchronization playing of audio and video based on FFMPEG [J]. Computer Engineering and Design. 2013, 34(6): 2087-2092.

张昕, 吕凝, 王春雷, 等. 多媒体同步传输方法研究[J]. 吉林大学学报(信息科学版). 2009, 27(6): 573-578.ZHANG X, LYU N, WANG C L, et al. Transmission method of audio and video synchronization [J]. Journal of Jilin University (Information Science Edition), 2009, 27(6): 573-578.

Bertoglio L, Leonardi R, Migliorati P. Intermedia synchronization for videoconference over IP [J]. Signal Processing: Image Communication, 1999, 15(1): 149-164.

薛彬, 徐京, 王猛. 一种改进的基于时间戳的空间音视频同步方法[J]. 电子设计工程. 2013, 21(11): 88-93.XUE B, XU J, WANG M. An improved audio-video synchronization method based on timestamp [J]. Electronic Design Engineering. 2013, 21(11): 88-93.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

A Research on Software Architecture and its Application for ESGS

Wireless Doorbell System Design and Implementation on a Hadoop-based Cloud Platform

SCA-YOLO: Real-time Target Detection Based on Deformable Convolution and Context-aware Attention

Research on Foreign Object Detection in Power Transmission Lines Based on the AAGV-YOLOX Model

An Optimal Operation Strategy for Community Microgrid Alliances Considering Power Exchange under Multi-package Shared Energy Storage Model

Related Author

Fan Rui

Yan Si-wei

Peng Zhong-huang

Liao Yong-le

Chen Yue-feng

Luo Xiao-hang

Lin Hen

Tan Zhi

Related Institution

No data

AI问答

⁰