understand through listening

What is Tongyi Hearing and Understanding

Tongyi Listening and Understanding is an intelligent work-study assistant based on the big model of Tongyi Thousand Questions launched by Aliyun, focusing on the efficient processing of audio and video content. It can quickly transcribe audio and video into text, support Chinese and English bilingualism and multiple dialects, with intelligent summary, summarization, multi-language translation and other functions. Users can highlight key points, mark questions, generate to-do lists, and export the original text, notes and audio/video with one click. It supports cross-file Q&A and can handle up to 6 hours of content. It is linked with AliCloud Disk, which facilitates users to transcribe and match subtitles directly. Tongyi Listening and Understanding is suitable for a variety of scenarios, such as meeting records, course learning, interviews and interviews, helping users efficiently organize and precipitate knowledge.

Main Functions of Tongyi Hearing and Understanding

• Real-time speech transcription: Supports real-time speech to text in Chinese, English, Japanese, Cantonese, and English/Chinese free speech, and can quickly generate meeting minutes or record content.
• Audio and video file transcription: Users can upload audio and video files for transcription in bulk, and the system will automatically differentiate between speakers and generate chapter sketches, full-text summaries, and summaries.
• Intelligent Abstracts and Summaries: Refine the core information of audio and video content through intelligent algorithms to generate full-text summaries, chapter sketches, speech summaries, and keyword lists.
• multilingual translation: It supports Chinese-English translation and many other languages, and can generate bilingual subtitles to help users cross the language barrier.
• Notes organization and export: Users can mark highlights, edit and organize notes with one click, and support exporting in multiple formats (e.g. Word, PDF, SRT subtitle files).
• Spokesperson distinction: It can automatically recognize the voice of different speakers and help users to review and organize efficiently.
• PPT Extract and Abstract: Extract the PPT content from the video and summarize the PPT presentation.
• Cross-device collaboration: Supports real-time viewing and updating of content across different devices, meeting the needs of users to process audio and video content anytime, anywhere.
• Industry Optimization Model: Provide exclusive optimized models for medical, legal and other industries to ensure high-precision performance in professional scenes.

Tongyi Listening to Wisdom official website address

Official website address: https://tingwu.aliyun.com/

How to use Tongyi Hearing Awareness

• Register & Login: Visit the Tongyi Awareness website, click on the "Register" button in the upper right corner, and use your cell phone number to register for an account. Once registration is complete, log in to the Tongyi Listening Console.
• Open Service: After logging in, click "Open Now" on the console's overview page.
• Select Service Type::
  • probation: Newly opened users can have a free trial for 90 days, with 48 hours of free credit per day for real-time recordings and 2 hours of free credit per day for audio/video file recordings.
  • commercial: Billed per usage, suitable for long term use.
• Create a project: Click on "My Projects" in the left navigation bar of the console, and then click on "Create Project". Enter a project name, select an object store (you can create a new bucket), and select a callback method (e.g. HTTP post or Rocket MQ).
• Usage Functions
  • Real-time speech transcription::
    • Click "Enable Real-time Recording" on the home page, and select the transcription language (support Chinese, English, Japanese, Cantonese, etc.).
    • Click "Start Recording" to transcribe your voice in real time.
    • Highlights, questions and to-do lists can be marked during the transcription process.
  • Audio and video file transcription::
    • Upload audio and video files on the console (maximum 6 hours for a single file, audio ≤ 500MB, video ≤ 6GB).
    • The system automatically transcribes the content, generating full-text summaries, quick chapter overviews and presentation summaries.
  • Intelligent Summarization and Translation::Support Chinese and English translation and multi-language translation, can generate bilingual subtitles.Automatically refine the core information of audio and video content to generate summaries.
  • Cross-device use::Support web version, Windows/Mac client, WeChat applet, recording files are stored in the cloud for easy access at any time.
• Exporting and Organizing: After the transcription is completed, the original text, notes, audio/video and translation can be exported with one click, supporting multiple formats (e.g. Word, PDF, SRT subtitle files). You can highlight the key points, mark questions and generate to-do lists in the record, which is convenient for subsequent organization and review.

Product Advantages of Tongyi Hearing

• Powerful AI capabilities: Relying on the big model of Tongyi Thousand Questions, it has efficient semantic understanding and content processing capabilities.
• Multi-Platform Adaptation: Supports multiple platforms such as web pages, applets, and PC/Mac clients.
• high quality-price ratio: The free transcription amount is high enough to meet the basic needs of most users.

Application Scenarios of Tongyi Hearing and Understanding