Tag

Chunking

0 views collected around this technical thread.

Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Feb 17, 2025 · Backend Development

Large File Upload with Chunking, Instant Upload, and Resume Using React, Vue and NestJS

This article explains how to implement a large‑file upload system that splits files into chunks, computes MD5 hashes for instant‑upload detection, supports breakpoint resume, and merges the chunks on the server using React or Vue on the frontend and NestJS with TypeScript on the backend.

ChunkingFile UploadMD5
0 likes · 6 min read
Large File Upload with Chunking, Instant Upload, and Resume Using React, Vue and NestJS
DataFunSummit
DataFunSummit
Jan 22, 2025 · Artificial Intelligence

RAG2.0 Engine Design Challenges and Implementation

This article presents a comprehensive overview of the RAG2.0 engine design, covering RAG1.0 limitations, effective chunking methods, accurate retrieval techniques, advanced multimodal processing, hybrid search strategies, database indexing choices, and future directions such as agentic RAG and memory‑enhanced models.

ChunkingHybrid SearchRAG
0 likes · 23 min read
RAG2.0 Engine Design Challenges and Implementation
Zhihu Tech Column
Zhihu Tech Column
Jan 17, 2025 · Artificial Intelligence

Zhihu Direct Answer: Product Overview and Technical Practices

This article summarizes the key technical insights from Zhihu Direct Answer, an AI-powered search product, covering its product overview, RAG framework, query understanding, retrieval strategies, chunking, reranking, generation techniques, evaluation methods, and engineering optimizations for cost and performance.

AI SearchChunkingEngineering Optimization
0 likes · 13 min read
Zhihu Direct Answer: Product Overview and Technical Practices
Sohu Tech Products
Sohu Tech Products
Nov 27, 2024 · Artificial Intelligence

RAG Technology and Practical Application in Multi-Modal Query: Using Chinese-CLIP and Redis Search

The article explains how Retrieval‑Augmented Generation (RAG) outperforms direct LLM inference by enabling real‑time knowledge updates and lower costs, and demonstrates a practical multi‑modal RAG pipeline that uses Chinese‑CLIP for vector encoding, various chunking strategies, and Redis Search for fast vector storage and retrieval.

Chinese CLIPChunkingLLM
0 likes · 17 min read
RAG Technology and Practical Application in Multi-Modal Query: Using Chinese-CLIP and Redis Search
vivo Internet Technology
vivo Internet Technology
Jul 3, 2024 · Databases

End-to-End Data Consistency Verification for MySQL in DTS

The Vivo Internet Storage R&D team's article describes an end‑to‑end MySQL data‑consistency verification tool for DTS that uses fixed‑size chunking and CRC32/MD5 fingerprint aggregation to quickly compare source and target tables, pinpoint mismatched rows, and enable automated or manual correction while minimizing impact on replication.

CRC32ChunkingDTS
0 likes · 13 min read
End-to-End Data Consistency Verification for MySQL in DTS
Code Ape Tech Column
Code Ape Tech Column
Sep 14, 2021 · Backend Development

Large File Upload with Chunking, Resume, and RandomAccessFile in Java

This article explains how to handle multi‑gigabyte video uploads by splitting files into chunks, using MD5 for identification, implementing resumable and instant uploads with Spring Boot and Redis, and leveraging Java's RandomAccessFile and memory‑mapped I/O for efficient merging.

ChunkingFile UploadJava
0 likes · 15 min read
Large File Upload with Chunking, Resume, and RandomAccessFile in Java
Xueersi Online School Tech Team
Xueersi Online School Tech Team
Aug 6, 2021 · Backend Development

Understanding RTMP Handshake, Chunking, and Nginx‑RTMP Live Streaming Implementation

This article explains the RTMP protocol’s handshake process, chunking and message formats, details command flows such as connect, createStream, publish and play, and describes how the Nginx‑RTMP module implements live streaming, acceleration, authentication, recording and HLS slicing.

ChunkingLive VideoMedia Server
0 likes · 21 min read
Understanding RTMP Handshake, Chunking, and Nginx‑RTMP Live Streaming Implementation