Tagged articles
Data Storage
88 articles · Page 1 of 1
The article explains MySQL's storage architecture, compares DELETE, TRUNCATE and DROP for removing data, shows how DELETE leaves hidden rows and generates logs that waste space, and advises using TRUNCATE, DROP or OPTIMIZE TABLE to reclaim disk space and avoid irreversible mistakes.
DELETEDROPData Storage
0 likes · 8 min read

Lance BlobV2 introduces a PyArrow ExtensionType for large binary objects, enabling lazy streaming, external URI references, range slicing, and flexible ingest or reference modes, while providing clear APIs and schema helpers that address the limitations of previous blob implementations.
BlobV2Data StorageExtensionType
0 likes · 24 min read

From the 1962 IBM 1311—an appliance‑sized, 9‑pound disk pack holding just 1.5 MB—to today’s pocket‑sized terabyte USB drives, this article traces six decades of magnetic storage breakthroughs, cost drops, and the societal impact of ever‑shrinking data capacity.
Data StorageIBM 1311hard drive history
0 likes · 12 min read

The article breaks down a big‑data project into four essential phases—data ingestion, preprocessing, storage, and analysis—explaining common pitfalls, practical tool choices, and why aligning technology with business needs is crucial for success.
Data IngestionData StorageHadoop
0 likes · 10 min read

The article explains Elasticsearch's cluster architecture, covering nodes, shards, replicas, two deployment models, data‑layer design, and the trade‑offs of each approach, while also comparing alternative distributed storage architectures and their impact on reliability and performance.
Data StorageDeployment ModesElasticsearch
0 likes · 14 min read

The article explains the definitions and practical differences of structured, semi‑structured, and unstructured data, compares suitable storage and processing technologies, discusses governance challenges, and offers a step‑by‑step strategy—including a data‑integration tool example—to help IoT projects select the optimal data architecture.
Data GovernanceData StorageIoT
0 likes · 10 min read

This guide shows how to implement a PHP function for user registration that validates input, hashes passwords, stores user details in a MySQL database, and a separate function for generic data storage, while highlighting key security considerations.
Data StorageMySQLPHP
0 likes · 4 min read

The article explains why MySQL recommends storing IPv4 addresses as unsigned 32‑bit integers instead of strings, detailing space savings, faster range queries, and indexing benefits, while also noting readability drawbacks and providing MySQL functions and Java code for converting between string and integer representations.
Data StorageIPv4MySQL
0 likes · 5 min read

JD Advertising built a massive ad‑data warehouse on Apache Doris, reaching nearly 1 PB and 18 trillion rows, then implemented a hot‑cold data tiering strategy—first a lake‑based approach, later a native tiering solution in Doris 2.0—reducing storage costs by 87% and boosting query performance over tenfold.
Apache DorisData Storagecold-hot tiering
0 likes · 18 min read

This tutorial walks through using Python to crawl Weibo, covering environment setup, three login methods, data extraction functions for user info, posts and comments, anti‑crawling strategies, storage to CSV or MySQL, a full example script, and legal considerations.
Data StorageWeiboanti‑crawling
0 likes · 12 min read

This article explains MySQL's storage architecture, why using DELETE to remove rows is discouraged, compares DELETE, DROP, and TRUNCATE in terms of speed, space reclamation, transaction behavior, and auto‑increment handling, and provides practical commands and optimization tips.
DELETEDROPData Storage
0 likes · 9 min read

BiFang is a lake‑stream integrated storage engine that merges Apache Pulsar message‑queue capabilities with Iceberg data‑lake features, providing a single unified data store with full‑incremental queries, sub‑second visibility, exactly‑once semantics, and seamless integration with Flink, Spark, and StarRocks for both real‑time analytics and batch processing.
Apache IcebergApache PulsarData Storage
0 likes · 13 min read

JD Advertising built a petabyte‑scale ad analytics service on Apache Doris, identified a hot‑cold access pattern, and implemented a native cold‑hot tiering solution (upgrading to Doris 2.0 and optimizing schema changes) that cut storage costs by ~87% and boosted concurrent query capacity over tenfold while simplifying operations.
Apache DorisData Storagebig data
0 likes · 18 min read

The article explains that using a 32‑bit UNSIGNED INT to store IPv4 addresses in MySQL saves space and improves index and range‑query performance, outlines the storage savings compared to VARCHAR, mentions the need for manual conversion, and provides MySQL and Java code examples for converting between string and integer representations.
Data StorageIPv4MySQL
0 likes · 5 min read


DevOpsJan 8, 2025 · Artificial Intelligence
The article explains how generative AI agents combine language models, tool integration, self‑guided planning, prompt‑engineering frameworks, extensions, function calls, and vector‑based data storage to create adaptable, retrieval‑augmented systems that can interact with real‑world APIs and perform complex tasks.
Data StorageRAGextensions
0 likes · 12 min read

This article surveys several lightweight Python databases—including PickleDB, TinyDB, ZODB, Durus, Buzhug, Gadfly, and PyTables—detailing their main features, typical use cases, cautions, and providing basic code examples to help developers choose and apply the right storage solution for small‑scale or prototype projects.
Data StorageNoSQLObject Persistence
0 likes · 23 min read

Using an unsigned INT to store IPv4 addresses in MySQL saves space and enables efficient range queries, while strings are larger and slower; the article explains these advantages, outlines conversion functions INET_ATON/INET_NTOA, shows equivalent handling for IPv6, and provides Java utilities for bidirectional conversion.
Data StorageIPv4Java
0 likes · 6 min read

This tutorial explains how to implement user registration and data storage in web applications using PHP functions, covering input validation, password hashing, MySQL connection, SQL insertion, and providing complete code examples for both registering users and storing generic data.
BackendData Storageuser registration
0 likes · 4 min read

This article explains Apache Hudi's clustering service, detailing its workflow, three execution modes, and layout optimization strategies—including linear, Z‑order, and Hilbert space‑filling curves—to improve storage locality and query performance in large‑scale data lake environments.
Apache HudiData StorageSpace-filling Curves
0 likes · 8 min read

This article explains why SQLite, the lightweight embedded relational database, is the most widely deployed database in the world, detailing its origins, core features, and diverse usage scenarios across mobile, embedded, desktop, data analysis, and web acceleration contexts.
Data StorageSQLiteWebAssembly
0 likes · 6 min read

This article explains how to use PHP functions to create a user registration system with input validation, password hashing, and MySQL insertion, and also demonstrates a generic data‑storage function that connects to a database and saves arbitrary data, highlighting key security and implementation steps.
Data StorageMySQLuser registration
0 likes · 4 min read

This article details the evolution of ByteDance's TLS (Tinder Log Service) from a Loki‑based prototype to an EB‑scale, cloud‑native log system, covering its core properties, data organization, architecture, caching, hybrid storage, private codec, ecosystem compatibility, intelligent features, and real‑world case studies.
ByteDanceData StorageTLS
0 likes · 24 min read

This article explains the fundamentals of data storage in computers, covering the concepts of RAM and DRAM, the role of capacitors and transistors, and how memory controllers and CPU caches work together to manage and accelerate access to binary information.
DRAMData StorageRAM
0 likes · 7 min read

This article demonstrates how to use PHP functions to implement user registration and data storage, covering input validation, password hashing, MySQL database connection, SQL insertion, and returning operation results, while highlighting security considerations and practical code examples.
Data StorageMySQLPHP
0 likes · 4 min read

This article shares Ant Group's extensive experience in big data governance, detailing the overall data governance framework, data quality management, data storage governance, and future considerations, illustrated with practical cases and strategies for ensuring compliance, reliability, and cost efficiency.
Ant GroupData GovernanceData Management
0 likes · 17 min read

Didi replaced its Elasticsearch‑based log platform with ClickHouse, redesigning architecture into isolated Log and Trace clusters, using hourly‑partitioned MergeTree tables and aggregating views to handle petabyte‑scale writes, diverse low‑latency queries, and high QPS, achieving over 400 nodes, 40 GB/s throughput, 30 % cost savings and four‑fold query latency reduction.
ClickHouseData StorageDistributed Database
0 likes · 15 min read

Zarr provides a modern, chunked and compressed storage format that lets you treat massive NumPy arrays like in‑memory objects, offering on‑demand loading, flexible back‑ends (disk, S3, zip), automatic caching, resizing, parallel reads/writes, and superior performance compared to traditional mmap‑based memmap files.
CompressionData StorageNumPy
0 likes · 18 min read

This article explains the hierarchy of digital storage units—from the single bit up to speculative sizes like Brontobyte and beyond—detailing their values, typical examples, and real‑world analogies such as characters per byte and the amount of text each unit can hold.
Data Storagebitsbytes
0 likes · 5 min read

This article explains the structure of NAND flash memory, how MOSFETs with floating‑gate and tunneling layers perform write operations for logical 0 and 1, how read operations detect stored electrons, and how matrix control enables block‑level access.
Data StorageFloating GateNAND
0 likes · 5 min read

The article explains the four main categories of computer storage—primary, secondary, tertiary, and offline—detailing their connection to the CPU, typical devices, the concept of direct‑attached storage, and an overview of RAID technology for performance and redundancy.
Data StorageDirect-Attached StorageRAID
0 likes · 5 min read

Vector databases store and search large-scale vector data, and in 2023 the five leading solutions—Chroma, Pinecone, Weaviate, Milvus, and Faiss—offer scalable, high-performance options for applications such as LLM-driven services, audio search, recommendation systems, image/video analysis, and semantic retrieval across various industries.
AIData StorageLLM
0 likes · 4 min read

The article argues that the era of big data is ending, showing that most organizations store only modest amounts of data, that storage costs outweigh benefits, and that modern cloud and analytics tools allow efficient processing without needing massive datasets.
AnalyticsData ManagementData Storage
0 likes · 16 min read

The forum explores the rapid growth and complexity of knowledge graphs, addressing storage and computation challenges through expert talks on graph database storage, query languages, practical implementation, and large‑scale financial knowledge graph platforms, offering attendees deep technical insights and hands‑on guidance.
Data Storagebig datagraph query
0 likes · 8 min read

This article explains how Zhihu adopted HDFS erasure coding to reduce storage costs, outlines cold‑hot file tiering policies, describes the EC conversion workflow and the custom EC Worker tool, and details methods for detecting and repairing damaged EC files in a Hadoop environment.
Data StorageErasure CodingHDFS
0 likes · 16 min read

The article explains the fundamentals of data storage in computers, describing how binary data is saved using memory modules, the differences between static SRAM and dynamic DRAM, and the role of memory controllers in translating addresses and managing refresh cycles.
DRAMData StorageRAM
0 likes · 6 min read

The talk outlines Baidu’s Baige AI IaaS solution for autonomous driving, detailing a low‑cost, high‑efficiency cloud stack that accelerates data access fivefold, boosts model training speed up to 391 %, cuts inference latency by 90 %, reduces simulation costs by 60 %, and explains the underlying storage, compute, container and GPU virtualization technologies.
AI IaaSAutonomous DrivingData Storage
0 likes · 17 min read


ITPUBDec 31, 2022 · Databases
This article examines HBase’s high reliability and performance as a column‑oriented NoSQL store, outlines its advantages and limitations, presents two practical use cases from e‑commerce, and details its data model, architecture components, and design considerations for effective deployment.
Data StorageHBaseNoSQL
0 likes · 12 min read

This article provides a comprehensive overview of the big data ecosystem, detailing nine essential technology categories—including data collection, storage, computation, analysis, resource management, retrieval, underlying infrastructure, and cluster installation—while comparing popular tools and illustrating their typical use‑cases with diagrams.
Data Storagecluster managementdata collection
0 likes · 11 min read

This article provides a comprehensive overview of the big data ecosystem, detailing nine core technology categories—from data collection and storage to computation, analysis, scheduling, and underlying infrastructure—along with tool comparisons, selection guidelines to help readers quickly build a complete big data knowledge system.
Data StorageTask SchedulingZooKeeper
0 likes · 12 min read

The article explains that using a 32‑bit UNSIGNED INT to store IPv4 addresses in MySQL saves space and improves indexing and range queries, outlines the conversion functions and their performance, discusses readability drawbacks, and provides Java code for bidirectional conversion between string and integer representations.
Data StorageIP addressJava
0 likes · 6 min read

The article explains why MySQL’s high‑performance guide recommends storing IPv4 addresses as a 32‑bit UNSIGNED INT instead of VARCHAR, detailing space savings, faster range queries, conversion functions (INET_ATON/INET_NTOA), associated drawbacks, and provides Java code to convert between string and integer representations.
Data StorageIPv4Java
0 likes · 5 min read

The 5th Techo TVP Developer Summit explored the surge of data, the strategic role of NoSQL in digital transformation, presented cutting‑edge trends, performance breakthroughs, cloud‑native multi‑model solutions, and real‑world case studies from finance to gaming, highlighting future directions for database technology.
Data StorageDatabase TrendsNoSQL
0 likes · 18 min read

This article provides a comprehensive overview of Oracle's database products, explaining why they matter, detailing the physical and logical storage structures, instance processes and memory areas, and tracing the evolution from early versions through RAC, multitenancy, and the latest 18c features.
Data StorageDatabase ArchitectureOracle
0 likes · 17 min read

This article explains how Prometheus, a data‑driven monitoring system, leverages a time‑series database (TSDB) to handle massive metric volumes, perform efficient queries, and enable powerful calculations such as recording rules for pre‑computed results.
Data StoragePrometheusTSDB
0 likes · 8 min read

This article explains Elasticsearch’s distributed cluster design, covering core concepts such as nodes, indices, shards, and replicas, compares mixed and tiered deployment models, examines data‑layer storage options, and discusses two typical distributed system architectures with their trade‑offs.
Cluster ArchitectureData StorageElasticsearch
0 likes · 15 min read

This article explains the core components of database systems, including their client‑server architecture, query processing, storage engine modules, classification by storage media (memory vs. disk), and the differences between row‑oriented and column‑oriented data layouts, concluding with future topics to explore.
Column LayoutData StorageRow Layout
0 likes · 8 min read

The article examines how to efficiently store read/unread status for group chat messages by replacing per‑user lists with compact bitmap structures, discusses handling member exits, presents C++‑style struct definitions, and quantifies storage savings compared to the naïve 8‑byte per‑user approach.
BitmapData Storagegroup chat
0 likes · 7 min read

This article explains the core concepts of Elasticsearch—including nodes, indices, shards, and replicas—covers its cluster and data‑layer architectures, compares mixed and tiered deployment models, and discusses the advantages and drawbacks of replica‑based distributed storage systems.
Cluster ArchitectureData StorageElasticsearch
0 likes · 15 min read

This article explains the limitations of CSV for big datasets, introduces the Feather binary format, shows how to install and use it with Python and pandas, and compares its saving/loading speed and storage size against CSV, highlighting Feather's advantages for efficient data handling.
Data StorageFeatherPandas
0 likes · 7 min read

This article explains the architecture of Elasticsearch clusters, covering node roles, index, shard and replica concepts, deployment models, data storage mechanisms, and compares two distributed system designs—local‑file‑system and shared‑file‑system—highlighting their advantages and trade‑offs.
Cluster ArchitectureData StorageElasticsearch
0 likes · 14 min read

The article explains how Prometheus, a data‑driven monitoring system, handles massive time‑series data using its TSDB storage engine, detailing concepts, query examples, storage characteristics, indexing mechanisms, and the benefits of pre‑computing rules for efficient monitoring at scale.
Data StoragePrometheusTSDB
0 likes · 8 min read

This article reviews the evolution of next‑generation data storage technologies, covering advances in storage media such as all‑flash and non‑volatile memory, modern storage architectures like software‑defined and hyper‑converged systems, emerging protocols (NVMe, NVMe‑oF), cloud‑based application models, and intelligent operation approaches.
Data StorageFlash MemoryHyper-Converged Infrastructure
0 likes · 14 min read

The article explains what a data lake is, its origins, key characteristics such as storing all raw data, flexible access, and low‑cost storage, compares it with traditional data warehouses, discusses advantages, common criticisms, and the types of users who can benefit from it.
Data ManagementData Storagedata lake
0 likes · 10 min read

The Mobile SkyNet platform adds a dedicated mobile monitoring layer to SaaS services, using Zanlogger for error, warning, and info logs, Kafka‑HBase pipelines for high‑throughput storage, WeChat‑based alerting, and an MPaaS console for issue visualization, reducing mobile‑side incidents by about twenty percent.
Backend IntegrationData StorageWeChat integration
0 likes · 11 min read

This article explains how Python persistence works by serializing objects with pickle and cPickle, compares file‑based and database storage, demonstrates basic and advanced usage—including handling circular references, custom classes, and versioning—and offers practical tips for maintaining pickled data across code changes.
Data StorageObject PersistencePickle
0 likes · 22 min read

This article explains Python object persistence, covering the concepts of serialization with pickle and cPickle, various storage mechanisms, handling of complex objects, reference cycles, class instance pickling, versioning strategies, and advanced techniques such as custom state methods and Pickler/Unpickler usage.
Data StoragePicklePython
0 likes · 22 min read

The article details JD's transition from a fragmented C‑end invoice service to a unified Invoice Center, describing the original user‑experience and architectural flaws, the DDD‑based layered redesign, performance‑boosting data and file‑handling strategies, achieved operational gains, and the planned next‑year initiatives.
DDDData Storageinvoice system
0 likes · 10 min read

This article provides a comprehensive overview of HDFS—including its design goals, core components, data read/write workflows, high‑availability mechanisms, federation, storage policies, colocation benefits, and practical usage scenarios—explaining why it is the foundational distributed file system for large‑scale data processing.
Data StorageFederationHDFS
0 likes · 17 min read

San CLI UI combines a San‑based client, a Node.js/Express GraphQL server, and lowdb file storage, enabling custom routing, component enhancements, and a versatile plugin system—supporting widgets, configurations, tasks, and custom views—managed through ClientAddonApi and PluginManager with IPC communication.
Data StorageFrontend DevelopmentGraphQL
0 likes · 18 min read

This article shares the Ctrip flight big‑data platform’s journey of evaluating and migrating data storage from Hive, MySQL and Redis to CrateDB, covering performance requirements, query patterns, maintenance challenges, containerization, and production results that reduced interface latency and resource consumption.
CrateDBCtripData Storage
0 likes · 10 min read

This article provides an in‑depth analysis of Apache Druid V1’s column‑oriented storage format, covering its dictionary, encoded dimension values, bitmap inverted index, array handling, and how these structures are used during query execution, illustrated with diagrams and code examples.
Apache DruidBitmap IndexColumnar
0 likes · 9 min read

This article explains why ClickHouse, the high‑performance columnar OLAP database, can return results on billions of rows within seconds, detailing its columnar storage, MergeTree engine, and how JD Cloud deploys and optimizes it on Kubernetes for scalability and reliability.
ClickHouseColumnar DatabaseData Storage
0 likes · 14 min read

This article explains the concepts, principles, and benefits of storage virtualization, covering host‑level, network‑level, and storage‑level approaches, and compares NAS and SAN technologies while highlighting how virtualization creates unified storage pools and reduces total cost of ownership.
Data StorageNASSAN
0 likes · 5 min read

This article provides a detailed introduction to HDFS, covering its application scenarios, core architecture, fault‑tolerance benefits, drawbacks such as high latency and small‑file inefficiency, essential shell and API commands, cluster management procedures, and newer Hadoop 2.0 features like HA, Federation, snapshots, ACLs, and heterogeneous storage.
CLIData StorageHA
0 likes · 10 min read

This article explains the fundamentals of data storage, covering hard‑disk hardware, internal structures, logical volumes, file systems, and the differences between direct‑attached, network‑attached, and storage‑area network solutions.
Data StorageLogical VolumeNAS
0 likes · 10 min read

This article provides an in‑depth analysis of Apache Druid V1's column‑oriented storage format, covering dimension structures, dictionaries, variable‑length integer encoding, inverted indexes, array handling, and how these components are used during query execution.
Apache DruidColumnar DatabaseData Storage
0 likes · 9 min read

This article reviews the challenges of compressing massive time‑series data, surveys existing methods, and introduces a novel two‑stage deep reinforcement learning framework (AMMMO) that adaptively selects compression modes, demonstrating significant compression ratio improvements and high throughput on large‑scale IoT and server workloads.
Data Storageadaptive algorithmsdeep reinforcement learning
0 likes · 18 min read

This article explains how to build user profiles by distinguishing persona from profile, describing the evolution of ID‑mapping techniques, designing a multi‑layer tag system, implementing statistical, interest, and model tags, storing the data in Hive, HBase, Codis and Elasticsearch, and finally evaluating profile timeliness, coverage and accuracy.
Data Storagebig datadata tagging
0 likes · 11 min read

This article examines WeChat's approach to Android data storage issues, detailing the limitations of internal and external storage, the gradual migration strategy, and the design of the wechat‑vfs component that provides abstracted file migration, encryption, and cleanup capabilities.
AndroidData StorageFile Migration
0 likes · 12 min read

This article provides a comprehensive overview of HDFS, covering its purpose, architecture, read/write mechanisms, replication strategies, component responsibilities, common command‑line tools, and the advantages and disadvantages of using Hadoop Distributed File System for large‑scale data storage.
Data StorageHDFSHadoop
0 likes · 10 min read

This article explains Elasticsearch's cluster architecture, including nodes, indices, shards, replicas, deployment models, and data layer storage, and compares two types of distributed data system designs—local file‑system based and shared‑storage based—highlighting their advantages and trade‑offs.
Cluster ArchitectureData StorageElasticsearch
0 likes · 13 min read

Learn how to start web scraping with Python by mastering the three core steps—fetching, analyzing, and storing data—using urllib and requests, handling login, evading anti‑scraping measures like user‑agents and IP proxies, and saving results to JSON, CSV, or MongoDB.
Data StoragePythonanti-scraping
0 likes · 9 min read

The article details NetEase Open Courses’ feed‑stream architecture, describing how content ingestion, multi‑level filtering, vertically and horizontally split storage, Elasticsearch indexing, two‑tier caching, and micro‑service orchestration combine to deliver personalized, high‑availability course feeds while addressing scalability, consistency, and operational challenges.
CachingData StoragePersonalization
0 likes · 16 min read

This article reviews a decade of MaxCompute development, covering its origins, core technologies, performance gains, ecosystem integration, intelligent features, competitive positioning, and commercialization, while highlighting the platform's role as Alibaba's central big‑data compute engine.
AI IntegrationCloud Data WarehouseData Storage
0 likes · 21 min read

This article provides a concise overview of three data storage solutions—Hive, MongoDB, and Redis—detailing their core concepts, operational principles, typical use cases, and key characteristics to help developers choose the appropriate technology for various workloads.
Data StorageHiveNoSQL
0 likes · 6 min read

This article analyzes the shortcomings of traditional relational databases in big‑data scenarios and introduces five major NoSQL categories—columnar, key‑value, document, full‑text search, and graph databases—detailing their principles, advantages, disadvantages, common implementations, and appropriate use cases to guide storage technology selection.
ColumnarData StorageNoSQL
0 likes · 18 min read

This article explains how high‑performance computing (HPC) supports oil‑field exploration by detailing the stages of seismic data acquisition, processing, and interpretation, the demanding computational and storage requirements, parallel communication patterns, checkpointing, and data lifecycle management, illustrating the role of HPC in modern geophysical workflows.
Data StorageHPCHigh-Performance Computing
0 likes · 12 min read

The article explains how cloud-driven demands and diverse data types have spurred the rise of multi-model databases, detailing their architecture, storage structures, compression techniques, and access methods using SequoiaDB as a concrete example.
BSONData StorageDatabase Architecture
0 likes · 14 min read

Meitu’s Naix distributed bitmap system accelerates massive user‑data analytics by using a three‑layer architecture, sharded RoaringBitmap storage, and PalDB, delivering over 600× faster queries than Hive, supporting fast generation plugins, fault‑tolerant replication, and millisecond‑level RPC query responses while reducing storage by 67%.
BitmapData StorageNaix
0 likes · 16 min read

Shingled Magnetic Recording (SMR) uses overlapping tracks to dramatically increase disk surface density, lowering cost per gigabyte, but it eliminates random writes, requiring new zone‑based management and exposing standards like ZBC and ZAC for host‑aware and drive‑managed implementations.
Data StorageSMRShingled Magnetic Recording
0 likes · 11 min read


21CTOSep 11, 2017 · Backend Development
This article details the architecture and evolution of a headline recommendation system, covering data aggregation, storage strategies using MySQL and Redis, challenges with reload latency and memory usage, and the optimizations—including data separation, Redis migration, and query pipeline improvements—that enabled scalable, efficient backend operations.
Data StoragePipelineRecommendation System
0 likes · 14 min read

This article explains the layered architecture of large‑scale web systems, covering flexible component choices, load distribution strategies, business service and communication layers, storage options from file to object systems, and key evaluation criteria such as cost, scalability, security, and maintainability.
BackendData Storageload-balancing
0 likes · 20 min read

Alluxio, formerly Tachyon, is a memory‑centric distributed file system that unifies heterogeneous big‑data storage backends, optimizes small files, and provides a fast, unified data access layer between storage systems like S3 or HDFS and compute frameworks such as Spark or Hadoop.
AlluxioCompute FrameworksData Storage
0 likes · 7 min read

This article examines the core technologies of big data—including data collection, storage, management, analysis, and mining—highlighting architectural challenges, analysis techniques, storage solutions, ETL processes, and the interplay between big data and cloud computing, while emphasizing practical implementation considerations.
Data StorageETLcloud computing
0 likes · 11 min read

This article explains the layered architecture of a web system, covering flexible component choices, load‑balancing techniques, business service and communication layers, various storage options—including file, block, and object storage—and key evaluation criteria for building robust, cost‑effective solutions.
Data Storagesystem designweb architecture
0 likes · 20 min read

This article provides a comprehensive overview of HBase, covering its distributed architecture, component roles, data organization, read/write mechanisms, and best practices for schema and region design to ensure efficient big‑data storage and retrieval.
Data StorageDistributed DatabaseHBase
0 likes · 17 min read

This article outlines the extensive technology stack behind Airbnb, covering its programming languages, client and server libraries, web server, data storage solutions, server services, and underlying hardware infrastructure that support its operations across 190 countries.
AirbnbData Storagebackend development
0 likes · 2 min read


21CTOMar 1, 2016 · Databases
Databases originated in the 1960s‑1990s when the United States consolidated wartime intelligence into computer‑stored Data Bases, and a review of their development from 1962 to 2016 reveals a relentless stream of technological breakthroughs that continuously enrich everyday life.
Data Storagecomputer sciencedatabases
0 likes · 1 min read
