Soft82.com » Windows » Developer Tools » Tools & Editors » Editors » IBM ViaVoice Toolkit for Animation 1.1

IBM ViaVoice Toolkit for Animation Description

This toolkit adds functions to IBM ViaVoice that can be used to generate "near real-time"

Lip synchronization ("lip sync") is the process of synchronizing a character's mouth movements with his speech. Currently, lip sync for animation is often done manually, and, when it is done automatically, it cannot be done in real time and the results are not accurate. Because ViaVoice provides an accurate acoustic model, the lip sync will also be accurate. In addition, because ViaVoice operates in "near real time," the lip sync can be done in near real time, opening many opportunities for real-time animation.

IBM ViaVoice Toolkit for Animation provides data files and a modified speech recognition engine that allows the ViaVoice dictation product to send phonetic and audio information to a client process to be used for synchronizing character mouth movement with the corresponding speech. In addition, it includes the header files neccesary for building a client as well as sample code and images for creating real-time or offline lip sync animations.

This technology opens the possibility for live animation of speaking characters and provides simple and accurate lip sync for scripted animation, bringing character dialog animation within reach of nonprofessionals.

The toolkit includes sample code that generates real-time Macromedia Flash animations. Software developers can use this example to help them integrate the technology into their animation systems. With IBM® ViaVoice® for Windows® R10 and this toolkit, developers have everything necessary for adding automatic lip sync capability to their animation systems.
How does it work?

Using the acoustic model of the ViaVoice dictation product, the recognition engine determines the most likely phonetic sequence that corresponds to the input audio and sends this information along with the captured audio to a client one hundred times per second through the ViaVoice application programming interface (SMAPI). The client then uses the phonetic information to select from among a small set of character images that correspond to each phone and assembles them in sequence along with the corresponding audio. The result is an animation of the character speaking in the voice of the user.

The feature that distinguishes an "aaaaaah" sound from an "eeeeee" sound is its frequency spectrum. We can measure the spectrum of speech one hundred times per second and match each of those spectra to the most likely sound that made it. All of speech can be broken down into a fairly small set of sounds called phones or phonemes. English has about fifty phonemes. In some languages, the sounds correspond fairly well to the written letters that represent the same word. English, which has words such as "through," is a little more complicated. The phonemes for "through" would be TH, R, and OO.

The sounds of the phonemes are determined by the shape of the lips, the position of the tongue, the amount of opening of the jaw, and the vibration of the vocal folds. When working in three dimensions (3D), animators usually try to be as realistic as possible, so they animate the jaw, lips, and tongue, and to that they add expressions associated with emotions such as speaking while smiling, so the number of different images can be large. For cartoons (two-dimensional animation), animators need not be as realistic, so the number of different images is usually smaller. For the demonstration included with the toolkit, we use twelve different mouth shapes. These shapes are called visemes, short for visual phonemes. There are fewer visemes than phonemes because the same mouth shapes can produce different sounds, for example B, P, and M. By displaying the twelve visemes in proper sequences, the animated character can be made to look as if it is speaking. This process is called lip synchronization. Because the phonetic information can be provided within one or two seconds of the original speech, the user can generate nearly real-time lip sync.

IBM ViaVoice Toolkit for Animation Download Button For Your Site

If you want to place a Download Button for IBM ViaVoice Toolkit for Animation on your website just insert the following code:

If you want a Link to this page you can use one of the logos bellow:

IBM ViaVoice Toolkit for Animation User Reviews

New Editors Software

TeXstudio May 22, 2012 An integrated environment for writing LaTeX documents				VbsEdit May 21, 2012 VBScript editor that dramatically reduces the time you spend writing VBS scripts
MS Developer Studio AddIn May 17, 2012 MS Developer Studio AddIn was designed for Microsoft Developer Studio				Modem Master ActiveX Component May 17, 2012 Powerful COM Port wrapper Active-X
AthTek Code to FlowChart May 17, 2012 Code to FlowChart generates flowchart from source code, to let code visual				Cibet May 17, 2012 The Cibet framework helps to control the execution of important business processes
TortoiseHg May 17, 2012 TortoiseHg is an all-inclusive Mercurial binary installer package for Windows				BitNami Jenkins Stack May 11, 2012 An easy-to-install distribution of Jenkins
DataMatch May 10, 2012 data quality, cleansing, matching and deduplication software in one easy to use				DeployMaster May 9, 2012 Installation builder delivering your software with a good first impression
CodeSmith Standard May 9, 2012 CodeSmith is a template-based code generator that allows you to generate code for any text language				ASPrunnerPro May 9, 2012 Database management tool
SynWrite (formerly Syn2) May 8, 2012 Plugin-editor with syntax hilighting				EditPlus May 8, 2012 EditPlus is a text and html editor for Windows
PilotEdit Lite May 7, 2012 An advanced text and hex editor that supports opening of files larger than 4GB				Komodo Edit May 7, 2012 Free multi-platform, multi-language editor for dynamic languages and Ajax tech
HelpSmith May 7, 2012 Create CHM HTML Help files and Printed Manuals easily with HelpSmith				Sprintometer May 4, 2012 A simple but powerful tool for management and tracking of SCRUM and XP
My Nes April 27, 2012 A portable open source NES/FAMICOM emulator written in C#				Zeta Resource Editor April 27, 2012 Application that enables you to edit standard Microsoft .NET string resources

Last 7 Days Most Downloaded Editors Products

Adobe (Macromedia) Dreamweaver 870 downloads Adobe Dreamweaver is a popular graphical web development tool.				EditPlus 346 downloads EditPlus is a text and html editor for Windows
Eclipse 228 downloads Eclipse is an open source community whose projects are focused on building an open development...				NetBeans IDE 124 downloads A modular developer tool for a wide range of development tasks
Notepad++ 83 downloads Notepad++ is source code editor and Notepad replacement				Help Generator for Visual Basic 6.0 65 downloads Help Generator and help editor to add Help to your applications easily.
Microsoft Visual Studio 2008 SDK 49 downloads Allows developers to integrate tools, editors, designers, languages, and other features				PowerBuilder Desktop 47 downloads Quickly deliver applications that solve business challenges using a robust, innovative and proven
Force 42 downloads a full-featured programming environment for FORTRAN 77 (the engineering programming language).				Microsoft .NET Framework 37 downloads A preview release of the latest version of the .NET Framework

All Time Most Downloaded Editors Products

Adobe (Macromedia) Dreamweaver 942,738 downloads Adobe Dreamweaver is a popular graphical web development tool.				EditPlus 276,929 downloads EditPlus is a text and html editor for Windows
Eclipse 75,667 downloads Eclipse is an open source community whose projects are focused on building an open development...				NetBeans IDE 64,082 downloads A modular developer tool for a wide range of development tasks
Notepad++ 60,393 downloads Notepad++ is source code editor and Notepad replacement				Help Generator for Visual Basic 6.0 27,276 downloads Help Generator and help editor to add Help to your applications easily.
Microsoft Visual Studio 2008 SDK 66,284 downloads Allows developers to integrate tools, editors, designers, languages, and other features				PowerBuilder Desktop 10,454 downloads Quickly deliver applications that solve business challenges using a robust, innovative and proven
Force 6,078 downloads a full-featured programming environment for FORTRAN 77 (the engineering programming language).				Microsoft .NET Framework 40,369 downloads A preview release of the latest version of the .NET Framework