This tutorial covers Java's three main IO stream types—byte, character, and conversion streams—demonstrating low-level vs high-level stream performance with file copy benchmarks, text file processing, console input handling, and character encoding conversion solutions.
This article explains how computers store Chinese characters using Unicode and UTF-8, covering the history of encoding chaos, Unicode code points, UTF-8 variable-length encoding rules, a step-by-step example of encoding '中', common mojibake causes, BOM, and programming best practices like using utf8mb4 in MySQL.
This article explains ASCII encoding, the standard that maps 128 characters to numbers 0-127, detailing control codes, printable characters, extended ASCII, programming applications like character comparison and case conversion, and why ASCII's English-only limitation led to Unicode.
This article explains how Python 3 treats all strings as Unicode by default, removing the need for encoding declarations required in Python 2, and demonstrates the behavior on Windows and Linux where the default environment encoding shifts from ASCII to UTF-8.
Unicode 18.0 adds 13,007 characters, raising the total to 172,808, highlighted by 11,328 Chinese seal script characters, Jurchen script, nine new emojis, three currency symbols, and a critical security fix for variation selectors to prevent hidden AI injection attacks.
This guide walks programmers through Unicode’s massive code space, its diverse scripts, encoding schemes like UTF‑8 and UTF‑16, combining marks, canonical equivalence, normalization forms, and grapheme clusters, explaining why the system is complex yet essential for global text handling.
The interview explores how Dan Blanchard used an LLM to completely rewrite the popular Python library chardet, the resulting performance boost, the contentious license change that sparked community backlash, and the broader legal and ethical questions surrounding AI‑generated open‑source code.
This article examines common misconceptions about MySQL VARCHAR—why 255 was historically used, the real maximum length, performance differences between short and long definitions, character‑set impacts on storage, and why aligning sizes to powers of two offers no real benefit.
This article explains how character encoding works—from ASCII and its extensions to Chinese GB2312 and GBK, through Unicode's UCS‑2, UCS‑4, and the versatile UTF‑8—showing why mismatched encodings produce garbled text and why UTF‑8 is the default in Spring Boot.
This guide explains how LCDs work as LED matrices, how to create and use dot‑matrix font libraries, the various modulo methods for mapping bits to bytes, differences between vector and bitmap fonts, and the Chinese character encodings (GB2312, GBK, GB18030) needed for multilingual embedded displays.
This article explains how computer text is represented by assigning unique numeric codes to characters and converting those codes into binary, then compares the most common Chinese encodings—ASCII, GB2312, GBK, GB18030, and UTF‑8—detailing their compatibility, byte lengths, and practical impact on software development.
This article explains the purpose and mechanics of common Chinese character encodings—including ASCII, GB2312, GBK, GB18030, UTF‑8, ANSI and Latin‑1—detailing how they map characters to numbers, handle byte boundaries, and maintain compatibility to avoid garbled text.
The article explains how a binary message on a multilingual public‑restroom sign was decoded by identifying UTF‑8 byte patterns, extracting the first 24 bits to reveal the Chinese character “向”, and providing a Java program that parses the entire bit string into readable Chinese text.
This article explains the history, purpose, and differences of major character encodings—including ASCII, GB2312, Unicode, and UTF-8—while showing how they are used and converted in modern computing environments.
This article explains how to set the correct character encoding for web pages and demonstrates PHP functions such as meta charset, iconv, urlencode/urldecode, and mysqli_real_escape_string with practical code examples to ensure proper display and safe database insertion.
The article explains that JavaScript’s native btoa() and atob() functions only handle ASCII, so to correctly base64‑encode Unicode strings you must convert them with TextEncoder to UTF‑8 bytes, use Uint8Array, and decode with TextDecoder, while checking for malformed surrogate pairs via isWellFormed or encodeURIComponent to avoid silent data loss.
The article explains that MySQL’s legacy “utf8” charset only supports three‑byte characters, causing errors with genuine four‑byte UTF‑8 symbols, and advises all MySQL/MariaDB users to migrate to the proper “utf8mb4” charset using available conversion guides.
This article explains the concepts of characters, character sets, and character encoding, describes how computers store and render text using methods like ASCII, GB2312, Unicode, and UTF‑8/16/32, and discusses why garbled text occurs across different languages and systems.
This guide explains the essential character set encodings—ANSI, ASCII, GB2312/GBK/GB18030, Unicode planes, UTF‑16, UTF‑32, and UTF‑8—and shows how they are used in MFC and Qt, providing code examples to avoid garbled text in software.
This article explains the fundamentals of character encoding, covering Unicode’s universal character set, the structure of its planes and surrogate areas, the variable‑length UTF‑8 and UTF‑16 encodings, Chinese‑specific GBK encoding, and practical iOS code examples for handling Unicode, emojis and regular‑expression based Chinese character detection.
This guide explains common character encodings such as ANSI, ASCII, GB2312/GBK/GB18030, Unicode, UTF‑8, UTF‑16, and UTF‑32, and shows how to handle them in MFC and Qt with practical code examples.
This article explains how emojis are represented in Unicode, covering basic code points, variation selectors, skin‑tone modifiers, zero‑width joiners, flag ligatures, tag sequences and keycap symbols, and shows how JavaScript can correctly process them using grapheme‑cluster techniques.
This article curates essential front‑end resources covering character encoding fundamentals, mobile screen adaptation strategies, practical ES6 tricks, Pinia state‑management advantages over Vuex, classic Git operations for code merging, and crucial browser memory knowledge for stable web applications.
This article explains the fundamentals of character sets and encodings—including ASCII, GB2312, GBK, Unicode, UTF‑8, UTF‑16, and UCS‑2—shows how they affect JavaScript string length, emoji handling, and common pitfalls such as combining characters, endianness, and BOM issues.
This article explains why MySQL's built‑in utf8 charset is not true UTF‑8, how inserting 4‑byte emoji characters triggers errors, and why switching the database, tables, and connection to utf8mb4 resolves the issue, along with a brief history of MySQL's encoding decisions.
This article explains why MySQL's traditional utf8 charset cannot store 4‑byte characters such as emojis, demonstrates the resulting insert errors, and shows how switching the database, system, and column collations to utf8mb4 resolves the issue while also providing a brief history of MySQL's charset implementation.
This article explains why MySQL's default utf8 charset cannot store four‑byte characters like emojis, demonstrates the resulting insert errors, and shows how switching to the utf8mb4 charset resolves the issue while providing a brief history of MySQL's encoding decisions.
This article explains why MySQL’s legacy utf8 charset only supports three‑byte characters, causing emoji insertion failures, and shows how switching tables, columns, and the database to utf8mb4 resolves the issue while detailing the historical reasons behind MySQL’s limited utf8 implementation.
The article traces character encoding from early telegraph and Morse code through ASCII, ISO national sets and Chinese standards, explains Unicode’s unification and its UTF‑8/‑16/‑32 forms, and shows how modern languages—especially JavaScript—handle code points, highlighting the cultural and technical significance for developers.
This tutorial explains the origins and evolution of character encoding, covering early ASCII, Chinese GBK/GB18030, the universal Unicode standard, UTF‑8 variable‑length encoding, and practical differences between Python 2 and Python 3 with code examples.
This article explains why Chinese characters become garbled on Windows when using Qt or Cocos2d‑x, explores ASCII, GBK, Unicode, UTF‑8 and ANSI encodings, shows how Visual Studio misdetects UTF‑8 files, and provides step‑by‑step solutions to eliminate the issue permanently.
This article explains MySQL's character encoding workflow, illustrates why queries containing Chinese characters fail without proper settings, and shows how to configure JDBC URLs, server variables, and Docker‑based MySQL instances to ensure lossless UTF‑8 handling.
This article walks through the evolution of character encoding—from the early ASCII standard, through Chinese extensions like GB2312 and GBK, to the universal Unicode system and its UTF‑32, UTF‑16, and UTF‑8 encodings—explaining their structures, usage, and common pitfalls.
This article explains how computers store text using binary, introduces ASCII, Unicode and UTF‑8 encoding rules, discusses the limitations of C‑style null‑terminated strings, and describes Redis's Simple Dynamic String (SDS) data structure, its old and new versions, advantages, and related APIs.
This article explains the history and purpose of Unicode, describes how character sets differ from encodings, details the storage formats of UTF‑8, UTF‑16, and UTF‑32, discusses byte order and BOM, and shows common encoding pitfalls in Redis and MySQL with practical solutions.
This article traces the evolution from ASCII to Unicode, explains how Unicode defines universal code points, compares the UTF‑8, UTF‑16 and UTF‑32 encoding schemes, discusses byte order and BOM, and shows practical fixes for common encoding problems in Redis and MySQL.
This article explains the process by which keyboard input is transformed into ASCII codes, how input methods map those codes to proprietary encodings, the role of code pages and fonts in rendering characters, and the use of Unicode, BOM, and endianness when saving text files.
This article explains why the garbled string “锟斤拷” appears in Chinese software, covering basic character encoding concepts, the Unicode replacement character, UTF‑8 decoding failures, and how GBK’s double‑byte scheme turns the placeholder bytes into the visible characters 锟、斤、拷.
This article explains how character encoding works, using ASCII, Unicode, UTF‑8 and GBK examples to reveal why the garbled string “锟斤拷” appears when mismatched encodings are processed, and shows the underlying byte‑level transformations.
This article explains how the PHP mb_detect_order() function configures or retrieves the list of character encodings used for automatic detection, describes its parameters and return values, and provides practical code examples for both string and array inputs.
The article explains why MySQL’s legacy “utf8” character set only supports three‑byte sequences, causing errors with genuine four‑byte UTF‑8 characters, and shows how the proper “utf8mb4” charset resolves the issue, including historical background, practical examples, and migration guidance.
The article explains the process by which computers render characters, covering binary representation, character encoding standards such as Unicode and GBK, the role of input methods, font files, and the challenges posed by rare characters and system compatibility.
This article explains how characters are turned into binary, mapped through Unicode and character sets, processed by input methods and font files, and finally rendered on screen, while also covering the challenges of rare characters and recent Unicode updates.
This article explains the fundamentals of characters, character sets and encodings such as ASCII, GB2312, Unicode, UTF‑8/16/32, BOM, and demonstrates how Java, browsers, Tomcat and MySQL handle encoding conversion, endianness and string length issues with practical code examples.
The article explains why MySQL's legacy "utf8" charset only supports three‑byte characters, causing storage errors for true four‑byte UTF‑8 symbols, and advises developers to migrate all MySQL/MariaDB databases to the proper "utf8mb4" charset.
This article explains why a C# char literal like '\x1d11e' is illegal, how Unicode code points map to glyphs, the role of code pages on Windows and Linux, and practical tips to avoid encoding mishaps across different programming languages.
This article explains the fundamentals of character encoding, covering concepts such as information, symbols, character sets, various encoding schemes like ASCII, GB2312, UTF‑8, Unicode planes, common pitfalls, and practical examples to help developers avoid garbled text.
This article explains the fundamentals of character encoding—from Morse‑code analogies and ASCII to Unicode, UTF‑8/UTF‑16/UTF‑32, and Chinese encodings like GB2312, GBK, and GB18030—illustrating how mismatched encodings cause garbled text and how to avoid them.
Discover why MySQL’s legacy ‘utf8’ charset only supports three‑byte characters, causing storage errors for true UTF‑8 data, and learn how switching to the proper ‘utf8mb4’ charset resolves these issues, with a brief history and practical migration guidance.
This article explains why MySQL’s legacy "utf8" charset only supports three‑byte characters, why it’s not true UTF‑8, and provides a clear guide to migrating databases to the proper "utf8mb4" charset for full Unicode support.
This article explains the origins of character sets, the relationships among various encodings such as ASCII, GB2312, GBK, GB18030, Unicode, UTF-8, UTF-16, and UTF-32, and shows how JavaScript handles Unicode and emoji characters, including practical code examples and solutions for length‑limited input fields.
This guide explains why MySQL tables default to latin1, demonstrates how to check and change table, session, and global character set settings, and shows the necessary my.cnf configuration changes to permanently enable UTF‑8 support for storing Chinese characters.
This article explains the fundamental concepts of characters, character sets, and encodings, compares common encodings such as ASCII, Unicode, and UTF‑8, and shows how Python 2 and Python 3 handle default encodings, string types, and common Unicode errors with practical code examples.
This article introduces the fundamentals of character encoding and decoding, explains the difference between character sets and encodings, and demonstrates practical Node.js examples using the iconv‑lite library to correctly encode and decode Chinese text, helping developers prevent common garbled‑text issues.
This article explains why encodeURIComponent can raise a URI malformed error, clarifies the concepts of high and low surrogate pairs, and provides a comprehensive overview of character sets, Unicode, and the UTF‑8 and UTF‑16 encodings used in JavaScript.
This article explains the fundamentals of character encoding, covering the evolution from the 7‑bit ASCII standard to Chinese GB2312, the development of Unicode and UTF‑8, and provides practical guidance for handling these encodings in Windows and Linux C programs, including a sample UTF‑8 detection function.
This article explains the fundamentals of character encoding, covering character sets, encoding rules, and common schemes such as ASCII, Unicode, UTF‑8, GB2312, GBK, and GB18030, helping developers prevent and resolve garbled text issues in web and database applications.
This article explains the multiple encoding/decoding steps MySQL performs when storing and retrieving data, identifies why mismatched character sets cause mojibake, and provides practical methods to avoid and repair corrupted text in MySQL tables.
This article explains character sets and encodings, shows why MySQL data can become garbled, and provides step‑by‑step methods—including proper configuration, common pitfalls, and reliable repair techniques—to prevent and correct encoding issues such as emoji storage failures.
This article explains why Chinese characters often appear as mojibake on Windows and Linux, introduces the history and technical details of ASCII, GB2312, GBK, GB18030 and Unicode, and provides concrete examples and command‑line tools for inspecting and converting file encodings.
This article explains how computers store and display characters using binary, defines character sets and encodings such as ASCII, GB2312, GBK, GB18030, BIG5 and Unicode, compares UTF‑8, UTF‑16, UTF‑32, and describes related HTTP headers like Accept‑Charset, Content‑Type, and Content‑Encoding.
This article explains the root causes of MySQL character‑set garbling, illustrates the encoding/decoding steps during data insertion and retrieval, and provides practical methods—including dump‑reload and binary conversion—to prevent and repair corrupted text.
