当前位置： 首页 > news >正文

使用AssemblyAI将音频数据转换成文本

news 2025/8/4 6:35:50

使用AssemblyAI将音频数据转换成文本

油管上有一个How To Call a REST API In Java - Simple Tutorial讲到
使用AssemblyAI 只需几行代码即可快速尝试我们的语音转文本和语音理解 AI 模型。首先我们得注册账号，然后登录账号，
到https://www.assemblyai.com/dashboard/activation页面可以看到自己的API Key，如下图所示：
AssemblyAI
这个API Key非常重要，在我们的代码中调用AssemblyAI库通过post和get请求将音频文件转录成文本时会使用到。上述图中可以看出官方给出了Python(SDK)、JavaScript(SDK)、Python、JavaScript、PHP、Ruby、C#等代码示例，居然没提供Java的。
一般我们使用AssemblyAI这个库将本地或者网络上存储的音频文件转换成文本需要两步走：

    1. 调用post请求通过AssemblyAI填充我们的audio_ull和API Key等参数，然后生成对应的transcript id
    1. 根据第一步生成的transcript id，再发送get请求，当转换完成后获取对应的转录text文本

AssemblyAI代码示例

  • Python(SDK)
# Install the assemblyai package by executing the command "pip install assemblyai"import assemblyai as aaiaai.settings.api_key = "填写你自己的API Key"# audio_file = "./local_file.mp3"
audio_file = "https://assembly.ai/wildfires.mp3"config = aai.TranscriptionConfig(speech_model=aai.SpeechModel.best)transcript = aai.Transcriber(config=config).transcribe(audio_file)if transcript.status == "error":raise RuntimeError(f"Transcription failed: {transcript.error}")print(transcript.text)
  • JavaScript(SDK)
// Install the assemblyai package by executing the command "npm install assemblyai"import { AssemblyAI } from "assemblyai";const client = new AssemblyAI({apiKey: "填写你自己的API Key",
});// const audioFile = "./local_file.mp3";
const audioFile = 'https://assembly.ai/wildfires.mp3'const params = {audio: audioFile,speech_model: "universal",
};const run = async () => {const transcript = await client.transcripts.transcribe(params);console.log(transcript.text);
};run();
  • Python
# Install the requests package by executing the command "pip install requests"import requests
import timebase_url = "https://api.assemblyai.com"headers = {"authorization": "填写你自己的API Key"
}
# You can upload a local file using the following code
# with open("./my-audio.mp3", "rb") as f:
#   response = requests.post(base_url + "/v2/upload",
#                           headers=headers,
#                           data=f)
# 
# audio_url = response.json()["upload_url"]audio_url = "https://assembly.ai/wildfires.mp3"data = {"audio_url": audio_url,"speech_model": "universal"
}url = base_url + "/v2/transcript"
response = requests.post(url, json=data, headers=headers)transcript_id = response.json()['id']
polling_endpoint = base_url + "/v2/transcript/" + transcript_idwhile True:transcription_result = requests.get(polling_endpoint, headers=headers).json()transcript_text = transcription_result['text']if transcription_result['status'] == 'completed':print(f"Transcript Text:", transcript_text)breakelif transcription_result['status'] == 'error':raise RuntimeError(f"Transcription failed: {transcription_result['error']}")else:time.sleep(3)
  • JavaScript
 // Install the axios and fs-extra package by executing the command "npm install axios fs-extra"import axios from "axios";
import fs from "fs-extra";const baseUrl = "https://api.assemblyai.com";const headers = {authorization: "填写你自己的API Key",
};// You can upload a local file using the following code
// const path = "./my-audio.mp3";
// const audioData = await fs.readFile(path);
// const uploadResponse = await axios.post(`${baseUrl}/v2/upload`, audioData, {
//   headers,
// });
// const audioUrl = uploadResponse.data.upload_url;const audioUrl = "https://assembly.ai/wildfires.mp3";const data = {audio_url: audioUrl,speech_model: "universal",
};const url = `${baseUrl}/v2/transcript`;
const response = await axios.post(url, data, { headers: headers });const transcriptId = response.data.id;
const pollingEndpoint = `${baseUrl}/v2/transcript/${transcriptId}`;while (true) {const pollingResponse = await axios.get(pollingEndpoint, {headers: headers,});const transcriptionResult = pollingResponse.data;if (transcriptionResult.status === "completed") {console.log(transcriptionResult.text);break;} else if (transcriptionResult.status === "error") {throw new Error(`Transcription failed: ${transcriptionResult.error}`);} else {await new Promise((resolve) => setTimeout(resolve, 3000));}
}
  • PHP
<?php
$ch = curl_init();
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);// replace with your API key
$YOUR_API_KEY = "填写你自己的API Key";// URL of the file to transcribe
$FILE_URL = "https://assembly.ai/wildfires.mp3";
// You can also transcribe a local file by passing in a file path
// $FILE_URL = './path/to/file.mp3';// AssemblyAI transcript endpoint (where we submit the file)
$transcript_endpoint = "https://api.assemblyai.com/v2/transcript";// Request parameters 
$data = array("audio_url" => $FILE_URL // You can also use a URL to an audio or video file on the web
);// HTTP request headers
$headers = array("authorization: " . $YOUR_API_KEY,"content-type: application/json"
);// submit for transcription via HTTP request
$curl = curl_init($transcript_endpoint);
curl_setopt($curl, CURLOPT_POST, true);
curl_setopt($curl, CURLOPT_POSTFIELDS, json_encode($data));
curl_setopt($curl, CURLOPT_HTTPHEADER, $headers);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
$response = curl_exec($curl);
$response = json_decode($response, true);
curl_close($curl);# polling for transcription completion
$transcript_id = $response['id'];
$polling_endpoint = "https://api.assemblyai.com/v2/transcript/" . $transcript_id;while (true) {$polling_response = curl_init($polling_endpoint);curl_setopt($polling_response, CURLOPT_HTTPHEADER, $headers);curl_setopt($polling_response, CURLOPT_RETURNTRANSFER, true);$transcription_result = json_decode(curl_exec($polling_response), true);if ($transcription_result['status'] === "completed") {echo $transcription_result['text'];break;} else if ($transcription_result['status'] === "error") {throw new Exception("Transcription failed: " . $transcription_result['error']);}sleep(3);
}
  • Ruby
require 'net/http'
require 'json'base_url = 'https://api.assemblyai.com'
headers = {'authorization' => '填写你的API Key','content-type' => 'application/json'
}audio_url = 'https://assembly.ai/wildfires.mp3'data = {"audio_url" => audio_url,"speech_model" => "universal"
}uri = URI.parse("#{base_url}/v2/transcript")
http = Net::HTTP.new(uri.host, uri.port)
http.use_ssl = true
request = Net::HTTP::Post.new(uri.request_uri, headers)
request.body = data.to_json
response = http.request(request)
response_body = JSON.parse(response.body)unless response.is_a?(Net::HTTPSuccess)raise "API request failed with status #{response.code}: #{response.body}"
endtranscript_id = response_body['id']
puts "Transcript ID: #{transcript_id}"polling_endpoint = URI.parse("#{base_url}/v2/transcript/#{transcript_id}")
while truepolling_http = Net::HTTP.new(polling_endpoint.host, polling_endpoint.port)polling_http.use_ssl = truepolling_request = Net::HTTP::Get.new(polling_endpoint.request_uri, headers)polling_response = polling_http.request(polling_request)transcription_result = JSON.parse(polling_response.body)if transcription_result['status'] == 'completed'puts "Transcription text: #{transcription_result['text']}"breakelsif transcription_result['status'] == 'error'raise "Transcription failed: #{transcription_result['error']}"elseputs 'Waiting for transcription to complete...'sleep(3)end
end
  • C#
using System;
using System.IO;
using System.Net.Http;
using System.Net.Http.Headers;
using System.Net.Http.Json;
using System.Text;
using System.Text.Json;
using System.Text.Json.Serialization;
using System.Threading.Tasks;class Program
{static readonly string BaseUrl = "https://api.assemblyai.com";static readonly string ApiKey = "填写你的API Key";static async Task<string> UploadFileAsync(string filePath, HttpClient httpClient){using (var fileStream = File.OpenRead(filePath))using (var fileContent = new StreamContent(fileStream)){fileContent.Headers.ContentType = new MediaTypeHeaderValue("application/octet-stream");using (var response = await httpClient.PostAsync("https://api.assemblyai.com/v2/upload", fileContent)){response.EnsureSuccessStatusCode();var jsonDoc = await response.Content.ReadFromJsonAsync<JsonDocument>();// Add null check to fix CS8602 warningreturn jsonDoc?.RootElement.GetProperty("upload_url").GetString() ??throw new InvalidOperationException("Failed to get upload URL from response");}}}static async Task Main(string[] args){using var httpClient = new HttpClient();httpClient.DefaultRequestHeaders.Add("authorization", ApiKey);// var audioUrl = await UploadFileAsync("./my_audio.mp3", httpClient);string audioUrl = "https://assembly.ai/wildfires.mp3";var requestData = new{audio_url = audioUrl,speech_model = "universal"};var jsonContent = new StringContent(JsonSerializer.Serialize(requestData),Encoding.UTF8,"application/json");using var transcriptResponse = await httpClient.PostAsync($"{BaseUrl}/v2/transcript", jsonContent);var transcriptResponseBody = await transcriptResponse.Content.ReadAsStringAsync();var transcriptData = JsonSerializer.Deserialize<JsonElement>(transcriptResponseBody);if (!transcriptData.TryGetProperty("id", out JsonElement idElement)){throw new Exception("Failed to get transcript ID");}string transcriptId = idElement.GetString() ?? throw new Exception("Transcript ID is null");string pollingEndpoint = $"{BaseUrl}/v2/transcript/{transcriptId}";while (true){using var pollingResponse = await httpClient.GetAsync(pollingEndpoint);var pollingResponseBody = await pollingResponse.Content.ReadAsStringAsync();var transcriptionResult = JsonSerializer.Deserialize<JsonElement>(pollingResponseBody);if (!transcriptionResult.TryGetProperty("status", out JsonElement statusElement)){throw new Exception("Failed to get transcription status");}string status = statusElement.GetString() ?? throw new Exception("Status is null");if (status == "completed"){if (!transcriptionResult.TryGetProperty("text", out JsonElement textElement)){throw new Exception("Failed to get transcript text");}string transcriptText = textElement.GetString() ?? string.Empty;Console.WriteLine($"Transcript Text: {transcriptText}");break;}else if (status == "error"){string errorMessage = transcriptionResult.TryGetProperty("error", out JsonElement errorElement)? errorElement.GetString() ?? "Unknown error": "Unknown error";throw new Exception($"Transcription failed: {errorMessage}");}else{await Task.Delay(3000);}}}
}

注意：只需要安装好assemblyai相关依赖只好，按照自己的需求参考上面的代码，替换自己的API key以及需要转录的音频文件，即可生成对应的转录文本。

以下面的Ptyhon代码为例：

# Install the requests package by executing the command "pip install requests"import requests
import timebase_url = "https://api.assemblyai.com"headers = {"authorization": "填写你自己的API key"
}
# You can upload a local file using the following code
with open("./audio_data/Thirsty.mp4", "rb") as f:response = requests.post(base_url + "/v2/upload",headers=headers,data=f)audio_url = response.json()["upload_url"]
print(f"Audio URL: {audio_url}")# audio_url = "https://assembly.ai/wildfires.mp3"data = {"audio_url": audio_url,"speech_model": "universal"
}url = base_url + "/v2/transcript"
response = requests.post(url, json=data, headers=headers)transcript_id = response.json()['id']
polling_endpoint = base_url + "/v2/transcript/" + transcript_idwhile True:transcription_result = requests.get(polling_endpoint, headers=headers).json()transcript_text = transcription_result['text']if transcription_result['status'] == 'completed':print(f"Transcript Text:", transcript_text)breakelif transcription_result['status'] == 'error':raise RuntimeError(f"Transcription failed: {transcription_result['error']}")else:time.sleep(3)

python代码运行示例

Java代码示例

如下是使用AssemblyAI将github上的音频文件转换成文本的Java代码示例，注意安装一下Gson库：
// Transcript.java

package org.example;public class Transcript {private String audio_url;private String id;private String status;private String text;private String error;public String getError() {return error;}public void setError(String error) {this.error = error;}public String getStatus() {return status;}public void setStatus(String status) {this.status = status;}public String getText() {return text;}public void setText(String text) {this.text = text;}public String getAudio_url() {return audio_url;}public void setAudio_url(String audio_url) {this.audio_url = audio_url;}public String getId() {return id;}public void setId(String id) {this.id = id;}
}

// Main.java

package org.example;import com.google.gson.Gson;import java.io.IOException;
import java.net.http.HttpClient;
import java.net.http.HttpRequest;
import java.net.http.HttpResponse;public class Main {private static final String API_KEY = "填写你自己的API Key";public static void main(String[] args) throws IOException, InterruptedException {String audio_url = "";Transcript transcript = new Transcript();transcript.setAudio_url("https://github.com/johnmarty3/JavaAPITutorial/blob/main/Thirsty.mp4?raw=true");Gson gson = new Gson();// 利用 Gson 将 Transcript 对象转换为 JSON 字符串String jsonRequest = gson.toJson(transcript);System.out.println("JSON Request: " + jsonRequest);// 构建 POST 请求HttpRequest postRequest = HttpRequest.newBuilder().uri(java.net.URI.create("https://api.assemblyai.com/v2/transcript")).header("Content-Type", "application/json").header("authorization", API_KEY).POST(HttpRequest.BodyPublishers.ofString(jsonRequest)).build();// 创建 HttpClient 实例HttpClient httpClient = HttpClient.newHttpClient();// 发送 POST 请求HttpResponse<String> postResponse = httpClient.send(postRequest, HttpResponse.BodyHandlers.ofString());System.out.println("postResponse: " + postResponse.body());// 将响应体转换为 Transcript 对象transcript = gson.fromJson(postResponse.body(), Transcript.class);System.out.println("Transcript ID: " + transcript.getId());// 构建 GET 请求以获取转录状态HttpRequest getRequest = HttpRequest.newBuilder().uri(java.net.URI.create("https://api.assemblyai.com/v2/transcript/" + transcript.getId())).header("authorization", API_KEY).GET().build();while (true) {// 发送 GET 请求以获取转录状态HttpResponse<String> getResponse = httpClient.send(getRequest, HttpResponse.BodyHandlers.ofString());// 将响应体转换为 Transcript 对象transcript = gson.fromJson(getResponse.body(), Transcript.class);
//            System.out.println("getResponse: " + getResponse.body());System.out.println(transcript.getStatus());if ("completed".equals(transcript.getStatus())) {break; // 如果转录完成，退出循环}  else if ("error".equals(transcript.getStatus())) {System.out.println("Transcription error." + transcript.getError());break; // 如果转录失败，退出循环} else {Thread.sleep(1000); // 如果转录未完成，等待 1 秒后重试}}System.out.println("Transcription completed.");// 输出转录文本System.out.println("Transcript text: " + transcript.getText());}
}

注意：上述Maven工程使用Gson库转换json字符串和对象，需要引入Gson依赖：

<dependency><groupId>com.google.code.gson</groupId><artifactId>gson</artifactId><version>2.13.1</version>
</dependency>

运行结果如下：

JSON Request: {"audio_url":"https://github.com/johnmarty3/JavaAPITutorial/blob/main/Thirsty.mp4?raw\u003dtrue"}
postResponse: {"id": "f3ffd34e-db34-4f89-b3d7-2c3bada97e3f", "language_model": "assemblyai_default", "acoustic_model": "assemblyai_default", "language_code": "en_us", "status": "queued", "audio_url": "https://github.com/johnmarty3/JavaAPITutorial/blob/main/Thirsty.mp4?raw=true", "text": null, "words": null, "utterances": null, "confidence": null, "audio_duration": null, "punctuate": true, "format_text": true, "dual_channel": null, "webhook_url": null, "webhook_status_code": null, "webhook_auth": false, "webhook_auth_header_name": null, "speed_boost": false, "auto_highlights_result": null, "auto_highlights": false, "audio_start_from": null, "audio_end_at": null, "word_boost": [], "boost_param": null, "prompt": null, "keyterms_prompt": null, "filter_profanity": false, "redact_pii": false, "redact_pii_audio": false, "redact_pii_audio_quality": null, "redact_pii_audio_options": null, "redact_pii_policies": null, "redact_pii_sub": null, "speaker_labels": false, "speaker_options": null, "content_safety": false, "iab_categories": false, "content_safety_labels": {}, "iab_categories_result": {}, "language_detection": false, "language_confidence_threshold": null, "language_confidence": null, "custom_spelling": null, "throttled": false, "auto_chapters": false, "summarization": false, "summary_type": null, "summary_model": null, "custom_topics": false, "topics": [], "speech_threshold": null, "speech_model": null, "chapters": null, "disfluencies": false, "entity_detection": false, "sentiment_analysis": false, "sentiment_analysis_results": null, "entities": null, "speakers_expected": null, "summary": null, "custom_topics_results": null, "is_deleted": null, "multichannel": null, "project_id": 671839, "token_id": 678042}
Transcript ID: f3ffd34e-db34-4f89-b3d7-2c3bada97e3f
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
processing
completed
Transcription completed.
Transcript text: These pretzels are making me thirsty.

其中Thirsty.mp4音频文件素材网址为：https://github.com/johnmarty3/JavaAPITutorial/blob/main/Thirsty.mp4

参考资料

  • How To Call a REST API In Java - Simple Tutorial
  • https://www.assemblyai.com/
  • https://github.com/assemblyai
  • CLI for the AssemblyAI API
  • Demo of AssemblyAI’s Real-Time Websocket API (In Browser with JavaScript)
  • Upload a local file and use AssemblyAI’s Speaker Labels model to display turn-by-turn utterances for your file.
  • https://github.com/AssemblyAI/assemblyai-node-sdk
  • https://github.com/AssemblyAI/assemblyai-java-sdk
    The AssemblyAI Java SDK provides an easy-to-use interface for interacting with the AssemblyAI API, which supports async and real-time transcription, audio intelligence models, as well as the latest LeMUR models.
  • https://github.com/google/gson
    A Java serialization/deserialization library to convert Java Objects into JSON and back
  • https://mvnrepository.com/artifact/com.google.code.gson/gson https://github.com/johnmarty3/JavaAPITutorial/blob/main/Thirsty.mp4
http://www.dtcms.com/a/312662.html

相关文章：

  • AI生成图片工具分享！
  • Linux的权限概念
  • 关于Web前端安全之XSS攻击防御增强方法
  • 【视频内容创作】PR的关键帧动画
  • 机器学习第三课之逻辑回归（三）LogisticRegression
  • Python-初学openCV——图像预处理（五）
  • 团队独立思考的力量
  • 论文阅读：DMD蒸馏 | One-step Diffusion with Distribution Matching Distillation
  • Python 动态属性和特性(定义一个特性工厂函数)
  • 「源力觉醒 创作者计划」_文心大模型4.5系列开源模型， 从一行代码到一个生态：聊聊开源战略那些事儿，顺便扯扯文心大模型 4.5 的使用心得
  • zookeeper分布式锁 -- 读锁和写锁实现方式
  • gpu instancer crowd 使用自定义材质并且只修改单个物体的材质参数
  • 【领域热点】【Vue】Vue 与 WebAssembly：前端性能优化的黄金搭档
  • 渗透高级-----应急响应
  • 机器翻译的分类：规则式、统计式、神经式MT的核心区别
  • 新电脑上GitHub推送失败？全面排查与解决指南
  • 第三章-提示词-高级：开启智能交互新境界（13/36）
  • Flutter Dart类的使用
  • WebMvc自动配置流程讲解
  • 【MySQL】MySQL的安全风险与安装安全风险
  • GraphRAG：基于知识图谱的检索增强生成技术解析
  • OSPF HCIP
  • RAG 中常见的文本分块（chunk）方法及实战代码示例
  • 基于开源AI智能客服、AI智能名片与S2B2C商城小程序的餐饮行业私域流量运营策略研究
  • JavaEE初阶第十三期：解锁多线程，从 “单车道” 到 “高速公路” 的编程升级（十一）
  • 最新Android Studio汉化教程--兼容插件包
  • 日产轩逸全面评测：可靠性高十万公里无大修，科技配置落后
  • Starrocks ShortCircuit短路径的调度
  • c++类和对象（0基础也能懂）
  • ThinkPHP8学习篇(一)：安装与配置