Tag

Data Generation

1 views collected around this technical thread.

Test Development Learning Exchange
Test Development Learning Exchange
Apr 12, 2025 · Backend Development

Efficient Data Flow Processing in an API Automation Testing Framework

This article explains how to implement efficient data flow handling in an API automation testing framework, covering data generation, parameterization, data transfer, storage, and validation with practical Python examples using built‑in libraries, Faker, pytest fixtures, JSON files, and MySQL.

API testingAutomationData Generation
0 likes · 8 min read
Efficient Data Flow Processing in an API Automation Testing Framework
Python Programming Learning Circle
Python Programming Learning Circle
Apr 12, 2025 · Backend Development

Using the Python Faker Library to Generate Mock Data for Testing

This article introduces the Python Faker library, explains how to install it, demonstrates basic usage with locale settings, lists various data generation methods (e.g., names, addresses, emails, IPs, credit cards), and provides a practical example of inserting fake records into a MySQL database.

Data GenerationMySQLPython
0 likes · 8 min read
Using the Python Faker Library to Generate Mock Data for Testing
Cognitive Technology Team
Cognitive Technology Team
Mar 17, 2025 · Artificial Intelligence

Leveraging Large Language Models to Optimize Traditional Machine Learning Pipelines

Large language models can assist and enhance each stage of traditional machine learning—including sample generation, data cleaning, feature engineering, model selection, hyper‑parameter tuning, and workflow automation—by generating synthetic data, refining features, selecting models, and orchestrating pipelines, though challenges such as bias, privacy, and noise remain.

Data GenerationHyperparameter OptimizationLLM
0 likes · 11 min read
Leveraging Large Language Models to Optimize Traditional Machine Learning Pipelines
DevOps
DevOps
May 29, 2024 · Artificial Intelligence

End-to-End Task-Oriented Dialogue Agent Construction Using Monte Carlo Simulation and LLM Fine-Tuning

This article presents an end‑to‑end approach for building task‑oriented dialogue agents by simulating user behavior with Monte Carlo methods, generating training data via LLMs, and efficiently fine‑tuning multiple large language models using LLaMA Factory, demonstrating significant improvements in intent recognition, slot filling, and contextual understanding.

Data GenerationLLM fine-tuningMonte Carlo simulation
0 likes · 17 min read
End-to-End Task-Oriented Dialogue Agent Construction Using Monte Carlo Simulation and LLM Fine-Tuning
Test Development Learning Exchange
Test Development Learning Exchange
May 20, 2024 · Backend Development

Why Generate Simulated ID Card Numbers for API Automation Testing and a Python GUI Generator

Generating simulated, legally‑formatted ID card numbers for API automation testing improves data realism, protects privacy, expands test coverage, and enables efficient, repeatable, parameterized, and performance testing, while the provided Python GUI script demonstrates how to create such data programmatically.

Data GenerationGUIID Card
0 likes · 10 min read
Why Generate Simulated ID Card Numbers for API Automation Testing and a Python GUI Generator
Test Development Learning Exchange
Test Development Learning Exchange
May 1, 2024 · Fundamentals

Using Python Generators for Dynamic Test Data Generation

This article explains how Python generators can be leveraged in interface automation testing to dynamically create test data, parameterize URLs, generate test cases, build report entries, tokens, HTTP status codes, query dates, API paths, report headings, and email templates, with complete code examples for each scenario.

Data GenerationGeneratorsPython
0 likes · 10 min read
Using Python Generators for Dynamic Test Data Generation
Code Ape Tech Column
Code Ape Tech Column
Jan 12, 2024 · Databases

MySQL Event Scheduler: Concepts, Operations, and Practical Examples

This article explains MySQL event scheduler fundamentals, including enabling/disabling the scheduler, creating, altering, and dropping events, scheduling syntax, and practical examples such as generating real-time sales data and periodic statistics, providing code snippets and best‑practice guidance for database automation.

Data GenerationDatabase AutomationEvent Scheduler
0 likes · 9 min read
MySQL Event Scheduler: Concepts, Operations, and Practical Examples
Selected Java Interview Questions
Selected Java Interview Questions
Jan 6, 2024 · Databases

MySQL Event Scheduler: Concepts, Operations, and Practical Examples

This article explains MySQL event scheduler fundamentals, its advantages, common commands for managing events, detailed syntax for creating events, and provides practical examples such as generating real‑time sales data and scheduled statistics, helping developers automate repetitive database tasks.

Data GenerationDatabase AutomationEvent Scheduler
0 likes · 10 min read
MySQL Event Scheduler: Concepts, Operations, and Practical Examples
Test Development Learning Exchange
Test Development Learning Exchange
Nov 9, 2023 · Backend Development

10 Common Python Automation Testing Scripts for API Testing

This article presents ten practical Python automation testing scripts—including batch test execution, data‑driven testing, API monitoring, performance measurement, database checks, screenshot capture, email reporting, data generation, logging, and response validation—to help developers streamline API testing and improve efficiency.

API testingAutomation TestingData Generation
0 likes · 7 min read
10 Common Python Automation Testing Scripts for API Testing
Python Programming Learning Circle
Python Programming Learning Circle
May 9, 2023 · Fundamentals

Python Automation Scripts: URL Shortener, Fake Data Generator, YouTube Downloader, NATO Encoder, and Selenium Login

This article showcases Python's concise syntax and powerful libraries by comparing a simple web request with JavaScript and providing five practical automation scripts—including a URL shortener, fake data generator, YouTube downloader, NATO alphabet encoder, and Selenium-based social‑media login—demonstrating why Python is ideal for repetitive tasks.

AutomationData GenerationPython
0 likes · 7 min read
Python Automation Scripts: URL Shortener, Fake Data Generator, YouTube Downloader, NATO Encoder, and Selenium Login
Top Architect
Top Architect
Apr 2, 2023 · Databases

Optimizing Large-Scale Pagination Queries in MySQL: Data Generation and Index Strategies

This article demonstrates how to generate millions of test rows in MySQL, analyzes the performance impact of deep pagination using LIMIT, explains why non‑clustered index lookups cause costly table scans, and presents two optimization approaches—sub‑query ID filtering and key‑set pagination—to dramatically reduce query latency.

Data GenerationIndex OptimizationMySQL
0 likes · 8 min read
Optimizing Large-Scale Pagination Queries in MySQL: Data Generation and Index Strategies
Python Programming Learning Circle
Python Programming Learning Circle
Mar 7, 2023 · Fundamentals

Python Automation Scripts: Web Requests, URL Shortening, Fake Data Generation, Video Downloading, NATO Encryption, and Selenium Login

This article presents a series of Python automation examples—including HTTP requests, URL shortening, fake data creation, YouTube video downloading, NATO‑style message encryption, and Selenium‑driven social‑media login—showcasing concise code snippets and explanations that highlight Python's simplicity and versatility for repetitive tasks.

AutomationData GenerationEncryption
0 likes · 7 min read
Python Automation Scripts: Web Requests, URL Shortening, Fake Data Generation, Video Downloading, NATO Encryption, and Selenium Login
360 Quality & Efficiency
360 Quality & Efficiency
Sep 2, 2022 · Backend Development

Automated Test Data Construction Using Metersphere, APIs, and Kafka

This article explains how to automatically generate large volumes of realistic test data for statistics, billing, and IoT scenarios by leveraging API calls, Metersphere timers, CSV-driven scripts, and custom Kafka producers, reducing manual effort while preserving data accuracy.

APIAutomationData Generation
0 likes · 8 min read
Automated Test Data Construction Using Metersphere, APIs, and Kafka
Python Programming Learning Circle
Python Programming Learning Circle
Jul 1, 2022 · Fundamentals

Mimesis: High‑Performance Python Fake Data Generator – Overview, Installation, and Usage

Mimesis is a high‑performance Python library for generating realistic fake data across multiple locales, offering a rich set of providers, schema‑based structured output, and easy integration with tools like Flask for testing, prototyping, and data anonymization.

Data GenerationFake DataFlask
0 likes · 6 min read
Mimesis: High‑Performance Python Fake Data Generator – Overview, Installation, and Usage
FunTester
FunTester
Apr 26, 2022 · Backend Development

Low‑Cost, Rapid Generation of High‑Quality Test Data Using Apifox

This article explains why test data is essential, introduces the Apifox tool as a low‑cost, fast solution for creating both generic and domain‑specific test data, and provides step‑by‑step guidance on using its mock engine, custom rules, batch generation, and automation features to produce reliable testing datasets.

API testingApifoxAutomation
0 likes · 9 min read
Low‑Cost, Rapid Generation of High‑Quality Test Data Using Apifox
FunTester
FunTester
Feb 23, 2021 · Backend Development

Improving Software Testability: Practical Tips for Captcha Handling, Data Generation, Mocking, and Test Code Deployment

This article shares practical techniques to enhance software testability, covering strategies for bypassing graphical and SMS captchas, efficient test data creation, automated and brute‑force data injection, mocking services, and deploying test‑specific code without affecting production environments.

Data Generationbackend testingcaptcha
0 likes · 11 min read
Improving Software Testability: Practical Tips for Captcha Handling, Data Generation, Mocking, and Test Code Deployment
Code Ape Tech Column
Code Ape Tech Column
Feb 8, 2021 · Databases

Evaluating the ‘No Join Over Three Tables’ Rule from Alibaba Java Development Manual with MySQL and Oracle Experiments

This article investigates why the Alibaba Java Development Manual advises against joining more than three tables by designing and executing large‑scale MySQL and Oracle experiments, analyzing query performance, indexing effects, and data‑generation scripts to determine the practical limits of multi‑table joins.

Data GenerationDatabase OptimizationJoin Performance
0 likes · 11 min read
Evaluating the ‘No Join Over Three Tables’ Rule from Alibaba Java Development Manual with MySQL and Oracle Experiments
Architecture Digest
Architecture Digest
Feb 2, 2021 · Databases

Why Alibaba's Java Development Manual Prohibits Joins Over Three Tables – MySQL and Oracle Performance Experiments

The article investigates the Alibaba Java Development Manual's rule against joining more than three tables by designing and executing extensive MySQL and Oracle experiments, generating massive test data, measuring query performance, and concluding that the restriction stems from join scalability limits on large datasets.

Data GenerationDatabase OptimizationJoin Performance
0 likes · 11 min read
Why Alibaba's Java Development Manual Prohibits Joins Over Three Tables – MySQL and Oracle Performance Experiments
Selected Java Interview Questions
Selected Java Interview Questions
Aug 24, 2020 · Databases

Performance Evaluation of Multi‑Table Joins in MySQL and Oracle with Large Data Sets

This article investigates the practical limits of joining more than three tables in MySQL by designing experiments with up to 1.5 billion rows, comparing indexed and non‑indexed queries, and contrasting the results with Oracle's performance, while providing full SQL scripts for data generation and analysis.

Data GenerationDatabase OptimizationJoin Performance
0 likes · 11 min read
Performance Evaluation of Multi‑Table Joins in MySQL and Oracle with Large Data Sets