LLPlayer: Video player that generates real-time subtitles with bilingual translation

General Introduction

LLPlayer is an open source media player designed for language learners, hosted on GitHub and created by developer umlx5h. It integrates a variety of useful features, such as bilingual subtitle display, AI auto-generated subtitles, real-time translation and word search, etc., aiming to help users improve their language skills by watching videos. Whether you're learning English, Japanese or any of the other 99 supported languages, LLPlayer provides a powerful aid. Based on the C# and Flyleaf libraries, the software is currently Windows-only, completely free and privacy-protected, with all subtitle generation and OCR processing done locally. It is especially suitable for anime fans, online course learners and users who need multi-language support.

Function List

• Bilingual subtitle display: Display both main and subtitle at the same time, support text and bitmap subtitle.
• AI Subtitle Generation (ASR): through OpenAI Whisper technology that generates subtitles from video and audio in real time and supports 99 languages.
• real time translation: Integration with Google and DeepL APIs to translate subtitles into 134 languages.
• Real-time OCR subtitling: Convert bitmap subtitles in videos to text with Tesseract and Microsoft OCR support.
• Subtitle Sidebar: Display subtitle list, support jump and word search, with anti-spoiler function.
• Instant Word Search: Click on the word in the subtitle to check the meaning, support customized browser search.
• loop: Supports single video loops for repeated learning.
• Taskbar progress display: Displays the playback progress and control buttons on the Windows taskbar.

Using Help

Installation process

LLPlayer is an open source project, you need to download and install it manually, here are the detailed steps:

1. Visit the GitHub page
   Open your browser and enter the URL https://github.com/umlx5h/LLPlayerTo get started, go to LLPlayer's GitHub page.
2. Download the latest version
   Click on the "Releases" tab at the top of the page to find the latest version (e.g. v0.x.x). Click on the corresponding .zip Files (e.g. LLPlayer-windows-x64.zip) Download the software zip package. Note: Make sure your system is Windows, other operating systems are not currently supported.
3. Unzip the file
   After downloading, right-click on the zip file and select "Extract to current folder" or use decompression software (such as WinRAR) to decompress it to any directory, for example C:\Program Files\LLPlayerThe
4. running program
   Go to the unzipped folder and find the LLPlayer.exe, double-click it to run it. The first launch may take a few seconds to load the dependency libraries.
5. Optional: Model Download
   If you are using the AI Subtitle Generation (ASR) feature, the first time you run the program you will be prompted to download the OpenAI Whisper model. After clicking Confirm, the program will automatically download the model from the network (this is the only time an Internet connection is required) and store it locally when it is finished.

caveat::

• Make sure the computer has enough storage space (the model takes up about a few hundred MB).
• NET environment, go to the Microsoft website to download and install the .NET Runtime (the version needs to match the LLPlayer requirements, usually described on the GitHub page).

How to use

After the installation is complete, double-click the LLPlayer.exe Start the program. The following are detailed operating instructions for the main functions:

1. Loading video and subtitles

• Open the video fileClick the "File" menu in the upper left corner of the interface, select "Open File", browse and select a local video (e.g., "Video"). .mp4,.mkv). Supports most common video formats.
• Loading external subtitles: If there is a ready-made subtitle file (.srt maybe .ass), select "Load Subtitle File" in the "Subtitle" menu to load main subtitle and sub-title respectively. The main subtitle is displayed at the bottom of the screen and the subtitle at the top.
• Online Video Support: Choose "Open URL" in the "File" menu and enter a link to a video such as YouTube (you need to install the yt-dlp utility, see the GitHub Wiki for details on how to configure it).

2. Bilingual subtitle display

• Setting Language Preferences: Go to "Subtitle Settings" in the "Settings" menu and select the language for the main subtitle and subtitle. For example, set the main subtitle to Japanese and the subtitle to Chinese.
• Adjusting the display styleRight-click on the subtitle area, and the popup menu can adjust the font, size and color. Support to hide subtitle separator (check "Hide separator" in "Settings").

3. AI subtitle generation (ASR)

• Enable ASR: After playing the video, click "ASR Settings" in the "Subtitle" menu, and check "Enable Automatic Speech Recognition".
• Select Language: Select the language of the video in the drop-down menu (e.g. English, Japanese) and click "Apply".
• real time generation: Subtitles are automatically generated and displayed according to the progress of the playback. For acceleration, go to "Hardware Options" and enable NVIDIA CUDA or AMD Vulkan (GPU compatibility required).
• Save Subtitles: Once generated, right-click on the subtitle area and select "Export Subtitles", save as .srt Documentation for subsequent use.

4. Real-time translation

• Configuring the Translation API: Go to "Translation Settings" in "Settings" and enter the API key of Google or DeepL (you need to register yourself to get it).
• Enable Translation: Check "Real-time Translation" in the "Subtitle" menu and select the target language (e.g. Chinese). The translation result will be displayed in the subtitle area.
• operating skill: Middle mouse button click on the subtitle to translate the whole sentence for quick understanding.

5. Real-time OCR subtitling

• Enable OCR: Select "OCR Settings" in the "Subtitle" menu, and check "Enable Real-time OCR".
• Recognizing Bitmap Captions: For hard subtitles embedded in videos (e.g. anime). The program will automatically recognize and convert to text.
• Language Optimization: For Japanese or Chinese, OCR automatically removes spaces between words to improve readability.

6. Subtitle sidebar and word search

• Show Sidebar: Click the "Subtitle Sidebar" button on the right side of the interface to display the list of subtitles of the current video.
• Jump Play: Double-click a line of subtitles and the video will jump to the corresponding point in time.
• Word Search: Select the word in the subtitle, right-click and select "Search" to open the browser search (e.g. Google) by default. You can customize the search site (e.g. Baidu, dictionary site) in "Settings".
• spoiler-proof: Check "Show current and previous subtitles only" to avoid seeing the subsequent content in advance.

7. Looping and taskbar control

• Setting up the loopRight-click on the video screen and select "Loop", then drag the progress bar to select the loop interval. It is suitable for learning a certain conversation over and over again.
• taskbar operation: After minimizing the window, the Windows taskbar displays a playback progress bar, which can be paused/played by clicking on it.

Example of operation process

Suppose you want to learn Japanese anime:

1. Open the anime video (.mp4).
2. Select "Japanese" in "ASR Settings" to generate Japanese subtitles.
3. Enable DeepL in "Translation Settings" to translate to Chinese and display bilingual subtitles.
4. Open the sidebar, and when you encounter a word such as "頑張る", right click to look up the word and jump to the dictionary website.
5. Set a certain conversation to play in a loop to practice listening and pronunciation over and over again.

tip

• performance optimization: If the generation of subtitles is slow, adjust the "Number of threads" in the ASR setting (not more than the number of CPU cores).
• Privacy: All functions except translation do not require an internet connection and data is stored locally.
• Feedback issues: If you encounter a bug, you can submit an Issue on GitHub and the developers will respond positively.

By following these steps, LLPlayer can help you get started with language learning!