当前位置： 首页 > wzjs >正文

学校网站建设培训心得体会海阳seo排名

wzjs 2025/9/9 6:22:05
学校网站建设培训心得体会,海阳seo排名,网页微博注销,百度代运营推广设计一个在Linux上运行的GCC C程序，同时连接两个不同的MySQL实例，两个实例中分别有两个Schema的表结构完全相同，复制一个实例中一个Schema里的所有表的数据到另一个实例中一个Schema里，使用以下快速高效的方法，加入异常…

设计一个在Linux上运行的GCC C++程序，同时连接两个不同的MySQL实例，两个实例中分别有两个Schema的表结构完全相同，复制一个实例中一个Schema里的所有表的数据到另一个实例中一个Schema里，使用以下快速高效的方法，加入异常处理，支持每隔固定时间重试一定次数，每张表的复制运行状态和记录条数，开始结束时间戳，运行时间，以及每个批次的运行状态，开始结束时间戳，运行时间，总记录条数都要到运行日志文件里，日志文件全部放在logs目录下，每天一个.log扩展名的文本文件，文件名带日期，所有运行参数写在json配置文件中。

C++程序分步解决方案：

文件结构

├── config.json          # 配置文件
├── include/             # 头文件目录
│   ├── DatabaseManager.h
│   ├── Logger.h
│   └── DataReplicator.h
├── src/                # 源文件目录
│   ├── main.cpp
│   ├── DatabaseManager.cpp
│   ├── Logger.cpp
│   └── DataReplicator.cpp
└── CMakeLists.txt      # 编译配置

1. 配置文件 (config.json)

{"source": {"host": "127.0.0.1","port": 3306,"user": "root","password": "source_pass","schema": "source_db"},"target": {"host": "127.0.0.1","port": 3307,"user": "root","password": "target_pass","schema": "target_db"},"retry": {"max_attempts": 3,"interval_seconds": 5},"batch_size": 1000,"log_dir": "./logs"
}

2. 日志类 (Logger.h/Logger.cpp)

// Logger.h
#include <fstream>
#include <string>
#include <mutex>
#include <chrono>class Logger {
public:static Logger& getInstance();void log(const std::string& message);private:Logger();~Logger();std::ofstream logFile;std::mutex mtx;std::string getCurrentDate();std::string getCurrentTimestamp();void openNewLogFile();
};

3. 数据库管理类 (DatabaseManager.h/DatabaseManager.cpp)

// DatabaseManager.h
#include <mysqlx/xdevapi.h>class DatabaseManager {
public:DatabaseManager(const mysqlx::SessionSettings& settings);mysqlx::Session& getSession();mysqlx::Schema getSchema(const std::string& name);private:mysqlx::Session session;
};

4. 数据复制核心类 (DataReplicator.h/DataReplicator.cpp)

// DataReplicator.h
#include <vector>
#include <string>
#include <functional>class DataReplicator {
public:struct TableStats {std::string table_name;size_t total_records = 0;std::chrono::system_clock::time_point start_time;std::chrono::system_clock::time_point end_time;bool success = false;};void replicateAllTables();private:std::vector<std::string> getSourceTables();void replicateTable(const std::string& tableName);void batchInsert(mysqlx::Table& source, mysqlx::Table& target, int batchSize);void withRetry(std::function<void()> operation, const std::string& context);
};

5. 主程序 (main.cpp)

#include "DatabaseManager.h"
#include "DataReplicator.h"
#include "Logger.h"
#include <nlohmann/json.hpp>using json = nlohmann::json;json loadConfig() {// 实现配置文件加载
}int main() {auto config = loadConfig();DatabaseManager sourceManager(createSettings(config["source"]));DatabaseManager targetManager(createSettings(config["target"]));DataReplicator replicator(sourceManager, targetManager, config);replicator.replicateAllTables();return 0;
}

6. 关键实现细节

  1. 批量数据复制：
void DataReplicator::batchInsert(mysqlx::Table& source, mysqlx::Table& target, int batchSize) {auto result = source.select("*").execute();std::vector<mysqlx::Row> buffer;while (auto row = result.fetchOne()) {buffer.push_back(row);if (buffer.size() >= batchSize) {target.insert().values(buffer).execute();buffer.clear();}}if (!buffer.empty()) {target.insert().values(buffer).execute();}
}
  1. 带重试的逻辑：
void DataReplicator::withRetry(std::function<void()> operation, const std::string& context) {int attempts = 0;while (attempts < maxRetries) {try {operation();return;} catch (const mysqlx::Error& e) {Logger::getInstance().log("Error: " + std::string(e.what()));if (++attempts >= maxRetries) throw;std::this_thread::sleep_for(retryInterval);}}
}
  1. 日志记录实现：
void Logger::log(const std::string& message) {std::lock_guard<std::mutex> lock(mtx);if (logFile.tellp() == 0 || getCurrentDate() != currentDate) {openNewLogFile();}logFile << "[" << getCurrentTimestamp() << "] " << message << std::endl;
}

7. 编译配置 (CMakeLists.txt)

cmake_minimum_required(VERSION 3.10)
project(DataReplicator)set(CMAKE_CXX_STANDARD 17)find_package(MySQLCppConn REQUIRED)
find_package(nlohmann_json REQUIRED)include_directories(include${MySQLCppConn_INCLUDE_DIRS}
)add_executable(data_replicatorsrc/main.cppsrc/DatabaseManager.cppsrc/Logger.cppsrc/DataReplicator.cpp
)target_link_libraries(data_replicatorPRIVATE MySQLCppConn::mysqlcppconnPRIVATE nlohmann_json::nlohmann_jsonpthread ssl crypto
)

8. 运行方式

mkdir -p build && cd build
cmake ..
make
./data_replicator

9. 日志示例

[2023-10-05 14:30:45] [users] STARTED
[2023-10-05 14:30:47] [users] BATCH 1-1000 inserted (1.2s)
[2023-10-05 14:30:49] [users] COMPLETED 1500 records (4.5s)
[2023-10-05 14:30:50] [products] FAILED: Duplicate entry 'XYZ' (Attempt 1/3)
[2023-10-05 14:30:55] [products] RETRY SUCCESS (2nd attempt)

优化建议

  1. 并行处理：
std::vector<std::future<void>> futures;
for (auto& table : tables) {futures.push_back(std::async(std::launch::async, [&](){replicateTable(table);}));
}
for (auto& f : futures) f.wait();
  1. 索引优化：
-- 复制前禁用索引
ALTER TABLE target_table DISABLE KEYS;-- 复制后重建索引
ALTER TABLE target_table ENABLE KEYS;
  1. 内存管理：
  • 使用智能指针管理数据库连接
  • 限制同时打开的连接数
  • 实现连接池机制

这个解决方案实现了：

  • 配置驱动的数据库连接
  • 带重试机制的可靠数据传输
  • 详细的运行日志记录
  • 批量处理优化
  • 异常安全保证
  • 可扩展的架构设计

完整的C++代码实现，包括各个头文件和源文件以及 CMakeLists.txt 的完整内容：

请确保安装了MySQL C++ Connector和 nlohmann_json 库，并按照运行方式中的步骤进行编译和运行。

include/DatabaseManager.h

#include <mysqlx/xdevapi.h>class DatabaseManager {
public:DatabaseManager(const mysqlx::SessionSettings& settings);mysqlx::Session& getSession();mysqlx::Schema getSchema(const std::string& name);private:mysqlx::Session session;
};

include/Logger.h

#include <fstream>
#include <string>
#include <mutex>
#include <chrono>class Logger {
public:static Logger& getInstance();void log(const std::string& message);private:Logger();~Logger();std::ofstream logFile;std::mutex mtx;std::string getCurrentDate();std::string getCurrentTimestamp();void openNewLogFile();std::string currentDate;
};

include/DataReplicator.h

#include <vector>
#include <string>
#include <functional>
#include <mysqlx/xdevapi.h>
#include <nlohmann/json.hpp>using json = nlohmann::json;class DataReplicator {
public:struct TableStats {std::string table_name;size_t total_records = 0;std::chrono::system_clock::time_point start_time;std::chrono::system_clock::time_point end_time;bool success = false;};DataReplicator(DatabaseManager& sourceManager, DatabaseManager& targetManager, const json& config);void replicateAllTables();private:std::vector<std::string> getSourceTables();void replicateTable(const std::string& tableName);void batchInsert(mysqlx::Table& source, mysqlx::Table& target, int batchSize);void withRetry(std::function<void()> operation, const std::string& context);DatabaseManager& sourceManager;DatabaseManager& targetManager;json config;int maxRetries;std::chrono::seconds retryInterval;int batchSize;
};

src/DatabaseManager.cpp

#include "../include/DatabaseManager.h"DatabaseManager::DatabaseManager(const mysqlx::SessionSettings& settings) : session(settings) {if (!session.isOpen()) {throw std::runtime_error("Failed to connect to database");}
}mysqlx::Session& DatabaseManager::getSession() {return session;
}mysqlx::Schema DatabaseManager::getSchema(const std::string& name) {return session.getSchema(name);
}

src/Logger.cpp

#include "../include/Logger.h"
#include <iostream>
#include <iomanip>Logger::Logger() {openNewLogFile();
}Logger::~Logger() {logFile.close();
}Logger& Logger::getInstance() {static Logger instance;return instance;
}std::string Logger::getCurrentDate() {auto now = std::chrono::system_clock::now();auto in_time_t = std::chrono::system_clock::to_time_t(now);std::tm tm_info;localtime_r(&in_time_t, &tm_info);std::ostringstream oss;oss << std::put_time(&tm_info, "%Y-%m-%d");return oss.str();
}std::string Logger::getCurrentTimestamp() {auto now = std::chrono::system_clock::now();auto in_time_t = std::chrono::system_clock::to_time_t(now);std::tm tm_info;localtime_r(&in_time_t, &tm_info);std::ostringstream oss;oss << std::put_time(&tm_info, "%Y-%m-%d %H:%M:%S");return oss.str();
}void Logger::openNewLogFile() {currentDate = getCurrentDate();std::string logFileName = config["log_dir"].get<std::string>() + "/" + currentDate + ".log";logFile.open(logFileName, std::ios::app);if (!logFile.is_open()) {std::cerr << "Failed to open log file: " << logFileName << std::endl;}
}void Logger::log(const std::string& message) {std::lock_guard<std::mutex> lock(mtx);if (logFile.tellp() == 0 || getCurrentDate()!= currentDate) {openNewLogFile();}logFile << "[" << getCurrentTimestamp() << "] " << message << std::endl;
}

src/DataReplicator.cpp

#include "../include/DataReplicator.h"
#include <iostream>
#include <future>DataReplicator::DataReplicator(DatabaseManager& sourceManager, DatabaseManager& targetManager, const json& config): sourceManager(sourceManager), targetManager(targetManager), config(config) {maxRetries = config["retry"]["max_attempts"];retryInterval = std::chrono::seconds(config["retry"]["interval_seconds"]);batchSize = config["batch_size"];
}std::vector<std::string> DataReplicator::getSourceTables() {auto schema = sourceManager.getSchema(config["source"]["schema"]);auto tables = schema.getTables();std::vector<std::string> tableNames;for (auto& table : tables) {tableNames.push_back(table.getName());}return tableNames;
}void DataReplicator::replicateTable(const std::string& tableName) {auto sourceSchema = sourceManager.getSchema(config["source"]["schema"]);auto targetSchema = targetManager.getSchema(config["target"]["schema"]);auto sourceTable = sourceSchema.getTable(tableName);auto targetTable = targetSchema.getTable(tableName);TableStats stats;stats.table_name = tableName;stats.start_time = std::chrono::system_clock::now();try {withRetry([&]() {batchInsert(sourceTable, targetTable, batchSize);}, tableName);stats.success = true;} catch (const mysqlx::Error& e) {Logger::getInstance().log("Error replicating table " + tableName + ": " + std::string(e.what()));stats.success = false;}stats.end_time = std::chrono::system_clock::now();auto duration = std::chrono::duration_cast<std::chrono::seconds>(stats.end_time - stats.start_time).count();std::string status = stats.success? "COMPLETED" : "FAILED";Logger::getInstance().log("[" + tableName + "] " + status + " " + std::to_string(stats.total_records) + " records (" + std::to_string(duration) + "s)");
}void DataReplicator::batchInsert(mysqlx::Table& source, mysqlx::Table& target, int batchSize) {auto result = source.select("*").execute();std::vector<mysqlx::Row> buffer;int batchCount = 0;auto batchStartTime = std::chrono::system_clock::now();while (auto row = result.fetchOne()) {buffer.push_back(row);stats.total_records++;if (buffer.size() >= batchSize) {withRetry([&]() {target.insert().values(buffer).execute();}, stats.table_name + " batch " + std::to_string(++batchCount));auto batchEndTime = std::chrono::system_clock::now();auto batchDuration = std::chrono::duration_cast<std::chrono::seconds>(batchEndTime - batchStartTime).count();Logger::getInstance().log("[" + stats.table_name + "] BATCH " + std::to_string((batchCount - 1) * batchSize + 1) + "-" + std::to_string(batchCount * batchSize) + " inserted (" + std::to_string(batchDuration) + "s)");batchStartTime = batchEndTime;buffer.clear();}}if (!buffer.empty()) {withRetry([&]() {target.insert().values(buffer).execute();}, stats.table_name + " batch " + std::to_string(++batchCount));auto batchEndTime = std::chrono::system_clock::now();auto batchDuration = std::chrono::duration_cast<std::chrono::seconds>(batchEndTime - batchStartTime).count();Logger::getInstance().log("[" + stats.table_name + "] BATCH " + std::to_string((batchCount - 1) * batchSize + 1) + "-" + std::to_string(stats.total_records) + " inserted (" + std::to_string(batchDuration) + "s)");}
}void DataReplicator::withRetry(std::function<void()> operation, const std::string& context) {int attempts = 0;while (attempts < maxRetries) {try {operation();return;} catch (const mysqlx::Error& e) {Logger::getInstance().log("Error: " + std::string(e.what()) + " (" + context + " Attempt " + std::to_string(attempts + 1) + "/" + std::to_string(maxRetries) + ")");if (++attempts >= maxRetries) throw;std::this_thread::sleep_for(retryInterval);}}
}void DataReplicator::replicateAllTables() {auto tables = getSourceTables();std::vector<std::future<void>> futures;for (auto& table : tables) {futures.push_back(std::async(std::launch::async, [&](){replicateTable(table);}));}for (auto& f : futures) f.wait();
}

src/main.cpp

#include "../include/DatabaseManager.h"
#include "../include/DataReplicator.h"
#include "../include/Logger.h"
#include <nlohmann/json.hpp>
#include <fstream>using json = nlohmann::json;json loadConfig() {std::ifstream configFile("config.json");json config;configFile >> config;return config;
}mysqlx::SessionSettings createSettings(const json& config) {mysqlx::SessionSettings settings;settings.setHost(config["host"]);settings.setPort(config["port"]);settings.setUser(config["user"]);settings.setPassword(config["password"]);return settings;
}int main() {auto config = loadConfig();mysqlx::SessionSettings sourceSettings = createSettings(config["source"]);mysqlx::SessionSettings targetSettings = createSettings(config["target"]);DatabaseManager sourceManager(sourceSettings);DatabaseManager targetManager(targetSettings);DataReplicator replicator(sourceManager, targetManager, config);replicator.replicateAllTables();return 0;
}

CMakeLists.txt

cmake_minimum_required(VERSION 3.10)
project(DataReplicator)set(CMAKE_CXX_STANDARD 17)find_package(MySQLCppConn REQUIRED)
find_package(nlohmann_json REQUIRED)include_directories(include${MySQLCppConn_INCLUDE_DIRS}
)add_executable(data_replicatorsrc/main.cppsrc/DatabaseManager.cppsrc/Logger.cppsrc/DataReplicator.cpp
)target_link_libraries(data_replicatorPRIVATE MySQLCppConn::mysqlcppconnPRIVATE nlohmann_json::nlohmann_jsonpthread ssl crypto
)

文章转载自：

http://PYGltCNe.kbynw.cn
http://JIbxRMoC.kbynw.cn
http://31i0m0Cg.kbynw.cn
http://QFKKwU5D.kbynw.cn
http://m7NF2PvS.kbynw.cn
http://OyAi1yGi.kbynw.cn
http://TGCBAa0A.kbynw.cn
http://9Hur5Rxy.kbynw.cn
http://4byU7CHx.kbynw.cn
http://2WjdTTwB.kbynw.cn
http://KC7s9Sw7.kbynw.cn
http://QCfxnNsk.kbynw.cn
http://KGyrRoHk.kbynw.cn
http://KiFN7Ce7.kbynw.cn
http://YOt8AWUm.kbynw.cn
http://ygjTqUhI.kbynw.cn
http://gO8VI9ex.kbynw.cn
http://VRYudwjE.kbynw.cn
http://lqffWonz.kbynw.cn
http://mYjTgiDt.kbynw.cn
http://bTbH6tmq.kbynw.cn
http://RNhkzsdC.kbynw.cn
http://6QvrCMM2.kbynw.cn
http://zePawO9s.kbynw.cn
http://XCvZjVIF.kbynw.cn
http://sgne1v3s.kbynw.cn
http://LIjwjntd.kbynw.cn
http://MMbXgMpl.kbynw.cn
http://pMu47brF.kbynw.cn
http://XkbfkmF9.kbynw.cn
http://www.dtcms.com/wzjs/650780.html

相关文章：

  • 分类 网站模板wordpress导出网页
  • win2008 iis建网站做网站用的软件是什么了
  • 软件行业 网站建设 模块网站建设与管理需要什么软件有哪些
  • 摄像头监控视频怎么做直播网站agile WordPress
  • 企业网站优化平台网站开发工具以及优缺点
  • app官方网站wordpress栏目
  • 义乌个人兼职做建设网站官方网站 建设情况汇报
  • 中国建设工程网官方网站爱 做 网站
  • 公司网站建站软件移动 网站 素材
  • 网站被收录后又被提出了wordpress 管网
  • 找券网站怎么做有什么做海报网站
  • 移动网站开发面试莱芜吧百度吧
  • 计算机网站开发项目注册邮箱企业邮箱
  • 电商平台设计电商网站建设如何做做网站
  • 通江县网站建设查建筑材料的网站
  • 网站备案必须做jquery 网站框架
  • 网站优化推广费用校园二手网站开发与设计任务书
  • 中英文对照网站怎么做如何扫描网站漏洞
  • 荥阳市建设局网站wordpress点开文章显示空白页
  • 国外酷炫网站有哪些什么是电商设计
  • 南昌网站建设案例如何设计个人网站
  • 潍坊做网站维护费用wordpress 付费 破解
  • 网站开发设计思路岳阳企业网站定制开发
  • 互联网个人用户网站小程序制作开发定制
  • 网站建设项目前分析深圳包装设计有限公司
  • 土木毕业设计代做网站广告制作公司员工提成
  • 动易网站怎么进入后台各大网站的域名是什么原因
  • 江苏高端品牌网站建设建筑工程网络计划称为
  • 旅游网站建设报价单wordpress 建门户网站
  • 查询个人信息最全的网站wordpress搭建电影网