当前位置: 首页 > news >正文

Python项目中Protocol Buffers的应用示例

项目结构

文件介绍

generated目录用于存储编译后的pb2文件
proto/user.proto定义的user协议
client.py模拟前后端分离向后端发起请求
server.py利用Flask创建简易web应用提供获取数据接口

依赖安装

protobuf==4.25.3
flask==3.0.2
flask-cors==4.0.0
(base) PS ......\protobuf-demo> conda activate protobuf-demo
(protobuf-demo) ......\protobuf-demo> pip install -r .\requirements.txt

proto编译

(protobuf-demo) PS D:\workspace\projects-py\protobuf-demo> protoc -I=proto --python_out=generated proto/user.proto

 执行代码后将会在generated目录中生成user.proto对应的pb2文件

文件拆解

proto/user.proto

syntax = "proto3";package user;message User {int32 id = 1;string name = 2;string email = 3;Role role = 4;enum Role {GUEST = 0;USER = 1;ADMIN = 2;}
}message UserRequest {int32 user_id = 1;}message UserResponse {User user = 1;}message UserListResponse {repeated User users = 1;}

user_pb2.py

import requestsfrom generated import user_pb2def get_user(user_id, sub_type='json'):print(f"Getting user {user_id} in {sub_type} format......")response = requests.get(url=f"http://localhost:5000/api/users/{user_id}",headers={'Accept': f'application/{sub_type}'})if response.status_code == 200:if sub_type == 'json':print(response.json())if sub_type == 'protobuf':# 反序列化user_response = user_pb2.UserResponse()user_response.ParseFromString(response.content)user = user_response.userprint(f"ID: {user.id}\n"f"Name: {user.name}\n"f"Email: {user.email}\n"f"Role: {user_pb2.User.Role.Name(user.role)}")else:print(f"Error: {response.status_code} - {response.text}")def list_users(sub_type='json'):print(f"Listing users in {sub_type} format......")response = requests.get(url=f"http://localhost:5000/api/users",headers={'Accept': f'application/{sub_type}'})if response.status_code == 200:if sub_type == 'json':print(response.json())if sub_type == 'protobuf':# 反序列化user_list_response = user_pb2.UserListResponse()user_list_response.ParseFromString(response.content)users = user_list_response.usersfor user in users:print(f"ID: {user.id}\n"f"Name: {user.name}\n"f"Email: {user.email}\n"f"Role: {user_pb2.User.Role.Name(user.role)}")else:print(f"Error: {response.status_code} - {response.text}")if __name__ == '__main__':get_user(1, 'json')get_user(1, 'protobuf')list_users('json')list_users('protobuf')

server.py

from flask import Flask, request, Response
from flask_cors import CORSfrom generated import user_pb2app = Flask(__name__)
CORS(app)# 模拟数据库
users_db = {1: user_pb2.User(id=1, name='张三', email='zhangsan@example.com', role=user_pb2.User.Role.ADMIN),2: user_pb2.User(id=2, name='李四', email='lisi@example.com', role=user_pb2.User.Role.USER),3: user_pb2.User(id=3, name='王五', email='wangwu@example.com', role=user_pb2.User.Role.GUEST),
}@app.route('/api/users/<int:user_id>', methods=['GET'])
def get_user(user_id):# 检查客户端接受的Content-typeaccept_header = request.headers.get('Accept', '')if user_id in users_db:user = users_db[user_id]# 确认返回数据格式if 'application/protobuf' in accept_header:# 返回protobuf格式response = user_pb2.UserResponse()response.user.CopyFrom(user)# 序列化返回return Response(response.SerializeToString(), content_type='application/protobuf')else:# 默认返回JSON格式return {'id': user.id,'name': user.name,'email': user.email,'role': user_pb2.User.Role.Name(user.role),}else:return {'error': 'User not found'}, 404@app.route('/api/users', methods=['GET'])
def list_users():# 检查客户端接受的Content-typeaccept_header = request.headers.get('Accept', '')if 'application/protobuf' in accept_header:# 返回protobuf格式response = user_pb2.UserListResponse()for user in users_db.values():response.users.append(user)# 序列化返回return Response(response.SerializeToString(), content_type='application/protobuf')else:# 默认返回JSON格式return [{'id': user.id,'name': user.name,'email': user.email,'role': user_pb2.User.Role.Name(user.role),}for user in users_db.values()]if __name__ == '__main__':app.run(debug=True, port=5000)

client.py

import requestsfrom generated import user_pb2def get_user(user_id, sub_type='json'):print(f"Getting user {user_id} in {sub_type} format......")response = requests.get(url=f"http://localhost:5000/api/users/{user_id}",headers={'Accept': f'application/{sub_type}'})if response.status_code == 200:if sub_type == 'json':print(response.json())if sub_type == 'protobuf':# 反序列化user_response = user_pb2.UserResponse()user_response.ParseFromString(response.content)user = user_response.userprint(f"ID: {user.id}\n"f"Name: {user.name}\n"f"Email: {user.email}\n"f"Role: {user_pb2.User.Role.Name(user.role)}")else:print(f"Error: {response.status_code} - {response.text}")def list_users(sub_type='json'):print(f"Listing users in {sub_type} format......")response = requests.get(url=f"http://localhost:5000/api/users",headers={'Accept': f'application/{sub_type}'})if response.status_code == 200:if sub_type == 'json':print(response.json())if sub_type == 'protobuf':# 反序列化user_list_response = user_pb2.UserListResponse()user_list_response.ParseFromString(response.content)users = user_list_response.usersfor user in users:print(f"ID: {user.id}\n"f"Name: {user.name}\n"f"Email: {user.email}\n"f"Role: {user_pb2.User.Role.Name(user.role)}")else:print(f"Error: {response.status_code} - {response.text}")if __name__ == '__main__':get_user(1, 'json')get_user(1, 'protobuf')list_users('json')list_users('protobuf')

环境启动 

启动服务端

(protobuf-demo) PS D:\workspace\projects-py\protobuf-demo> python .\server.py

启动客户端 

(protobuf-demo) PS D:\workspace\projects-py\protobuf-demo> python .\client.py

结果输出如下

Getting user 1 in json format......
{'email': 'zhangsan@example.com', 'id': 1, 'name': '张三', 'role': 'ADMIN'}
Getting user 1 in protobuf format......
ID: 1
Name: 张三
Email: zhangsan@example.com
Role: ADMIN
Listing users in json format......
[{'email': 'zhangsan@example.com', 'id': 1, 'name': '张三', 'role': 'ADMIN'}, {'email': 'lisi@example.com', 'id': 2, 'name': '李四', 'role': 'USER'}, {'email': 'wangwu@example.com', 'id': 3, 'name': '王五', 'role': 'GUEST'}]
Listing users in protobuf format......
ID: 1
Name: 张三
Email: zhangsan@example.com
Role: ADMIN
ID: 2
Name: 李四
Email: lisi@example.com
Role: USER
ID: 3
Name: 王五
Email: wangwu@example.com
Role: GUEST

总结

  1. protobuf 定义.proto 文件定义了数据结构,这是跨语言通信的基础

  2. 代码生成protoc 工具根据 .proto 文件生成各语言的代码

  3. 序列化/反序列化:使用 SerializeToString() 和 ParseFromString() 方法

  4. 内容协商:通过 HTTP 的 Accept 头决定返回 JSON 还是 protobuf 格式

  5. 类型安全:protobuf 提供了强类型检查,减少了运行时错误

http://www.dtcms.com/a/279720.html

相关文章:

  • MySQL Innodb Cluster介绍
  • 零基础 “入坑” Java--- 十一、多态
  • Spring Boot + Vue2 实现腾讯云 COS 文件上传:从零搭建分片上传系统
  • 并发编程核心概念详解:进程、线程与协程的本质与差异
  • 解锁HTTP:从理论到实战的奇妙之旅
  • Windows系统使用docker部署项目(有网与离线)
  • LeetCode--45.跳跃游戏 II
  • 破局与重构:文心大模型开源的产业变革密码
  • 北京饮马河科技公司 Java 实习面经
  • vscode 打开项目时候,有部分外部依赖包找不到定义或者声明,但是能使用cmake正常编译并且运行
  • C#——数据与变量
  • 软件构件组装三层次体系:定制、集成与扩展的深度解析
  • Product Hunt 每日产品热榜 | 2025-07-14
  • 【氮化镓】非辐射复合载流子诱导的瞬态缺陷机制
  • 实现dify关于python安装包功能的实现
  • java进阶(三):单例、工厂、模版方法与代理模式详解
  • 【25-cv-7832】TME携瓢虫少女动漫发起商标+版权维权案,近百家店铺被冻!!
  • Spring Boot 实现图片防盗链:Referer 校验与 Token 签名校验完整指南
  • 【html基本界面】
  • 李沐动手学深度学习Pytorch-v2笔记【08线性回归+基础优化算法】2
  • FreeRTOS之链表操作相关接口
  • 【深度学习框架终极PK】TensorFlow/PyTorch/MindSpore深度解析!选对框架效率翻倍
  • xss-lab靶场通关
  • 多租户云环境下的隔离性保障:虚拟化、容器、安全组如何协同防护?
  • python高阶调试技巧,替代pring
  • HDMI接口定义(二)
  • 网络编程7.12
  • 【elasticsearch9.0】【kibana】Docker安装
  • Java从入门到精通!第五天(面向对象(二))
  • JAR 包冲突排雷指南:原理、现象与 Maven 一站式解决