Tagged articles
character encoding
66 articles · Page 1 of 1
This article explains why MySQL's utf8 character set only supports up to three bytes per character, causing failures with emoji and complex characters, and details the historical reasons behind this limitation, recommending utf8mb4 for full UTF-8 support.
MySQLRFC 3629UTF-8
0 likes · 10 min read

MySQL's utf8 character set only supports up to three bytes per character, causing errors when storing emoji or complex characters that require four bytes; the article explains the historical reason for this limitation and demonstrates that utf8mb4 is the true UTF-8 implementation introduced in 2010.
MariaDBMySQLUTF-8
0 likes · 9 min read

This tutorial demonstrates implementing file upload and download using Java Servlets with Apache Commons FileUpload, including a CharacterEncodingFilter to handle UTF-8 encoding and resolve Chinese filename corruption during both upload and download operations.
Apache Commons FileUploadChinese FilenameFile Download
0 likes · 18 min read

This comprehensive guide details 20 critical technical checks for migrating from MySQL 5.7 to 8.0, covering authentication plugins, character sets, reserved words, strict SQL modes, replication setup, backup validation, and cutover procedures with executable SQL and bash examples.
AuthenticationDatabase MigrationDatabase Upgrade
0 likes · 23 min read

This tutorial covers Java's three main IO stream types—byte, character, and conversion streams—demonstrating low-level vs high-level stream performance with file copy benchmarks, text file processing, console input handling, and character encoding conversion solutions.
Buffered StreamsByte StreamsCharacter Streams
0 likes · 15 min read

This article explains how computers store Chinese characters using Unicode and UTF-8, covering the history of encoding chaos, Unicode code points, UTF-8 variable-length encoding rules, a step-by-step example of encoding '中', common mojibake causes, BOM, and programming best practices like using utf8mb4 in MySQL.
BOMMySQL utf8mb4UTF-8
0 likes · 10 min read

This article explains ASCII encoding, the standard that maps 128 characters to numbers 0-127, detailing control codes, printable characters, extended ASCII, programming applications like character comparison and case conversion, and why ASCII's English-only limitation led to Unicode.
ASCII tableUnicode precursorascii
0 likes · 7 min read

This article explains how Python 3 treats all strings as Unicode by default, removing the need for encoding declarations required in Python 2, and demonstrates the behavior on Windows and Linux where the default environment encoding shifts from ASCII to UTF-8.
PythonPython 2 vs Python 3Python 3
0 likes · 4 min read


21CTOSep 17, 2026 · Fundamentals
Unicode 18.0 adds 13,007 characters, raising the total to 172,808, highlighted by 11,328 Chinese seal script characters, Jurchen script, nine new emojis, three currency symbols, and a critical security fix for variation selectors to prevent hidden AI injection attacks.
AI securityChinese seal scriptJurchen script
0 likes · 7 min read

This guide walks programmers through Unicode’s massive code space, its diverse scripts, encoding schemes like UTF‑8 and UTF‑16, combining marks, canonical equivalence, normalization forms, and grapheme clusters, explaining why the system is complex yet essential for global text handling.
UTF-16UTF-8Unicode
0 likes · 21 min read

The interview explores how Dan Blanchard used an LLM to completely rewrite the popular Python library chardet, the resulting performance boost, the contentious license change that sparked community backlash, and the broader legal and ethical questions surrounding AI‑generated open‑source code.
AILicensePython
0 likes · 30 min read

This article examines common misconceptions about MySQL VARCHAR—why 255 was historically used, the real maximum length, performance differences between short and long definitions, character‑set impacts on storage, and why aligning sizes to powers of two offers no real benefit.
MySQLcharacter encodingperformance
0 likes · 13 min read

This article explains how character encoding works—from ASCII and its extensions to Chinese GB2312 and GBK, through Unicode's UCS‑2, UCS‑4, and the versatile UTF‑8—showing why mismatched encodings produce garbled text and why UTF‑8 is the default in Spring Boot.
GB2312GBKSpring Boot
0 likes · 9 min read

This guide explains how LCDs work as LED matrices, how to create and use dot‑matrix font libraries, the various modulo methods for mapping bits to bytes, differences between vector and bitmap fonts, and the Chinese character encodings (GB2312, GBK, GB18030) needed for multilingual embedded displays.
C++FreeTypeLCD
0 likes · 11 min read

This article explains how computer text is represented by assigning unique numeric codes to characters and converting those codes into binary, then compares the most common Chinese encodings—ASCII, GB2312, GBK, GB18030, and UTF‑8—detailing their compatibility, byte lengths, and practical impact on software development.
GB18030GB2312GBK
0 likes · 14 min read

This article explains the purpose and mechanics of common Chinese character encodings—including ASCII, GB2312, GBK, GB18030, UTF‑8, ANSI and Latin‑1—detailing how they map characters to numbers, handle byte boundaries, and maintain compatibility to avoid garbled text.
ChineseGBKUTF-8
0 likes · 13 min read

The article explains how a binary message on a multilingual public‑restroom sign was decoded by identifying UTF‑8 byte patterns, extracting the first 24 bits to reveal the Chinese character “向”, and providing a Java program that parses the entire bit string into readable Chinese text.
JavaUTF-8Unicode
0 likes · 4 min read

This article explains the history, purpose, and differences of major character encodings—including ASCII, GB2312, Unicode, and UTF-8—while showing how they are used and converted in modern computing environments.
GB2312UTF-8Unicode
0 likes · 11 min read

This article explains how to set the correct character encoding for web pages and demonstrates PHP functions such as meta charset, iconv, urlencode/urldecode, and mysqli_real_escape_string with practical code examples to ensure proper display and safe database insertion.
IConvMySQLiPHP
0 likes · 5 min read

The article explains that JavaScript’s native btoa() and atob() functions only handle ASCII, so to correctly base64‑encode Unicode strings you must convert them with TextEncoder to UTF‑8 bytes, use Uint8Array, and decode with TextDecoder, while checking for malformed surrogate pairs via isWellFormed or encodeURIComponent to avoid silent data loss.
Base64JavaScriptTextDecoder
0 likes · 14 min read

The article explains that MySQL’s legacy “utf8” charset only supports three‑byte characters, causing errors with genuine four‑byte UTF‑8 symbols, and advises all MySQL/MariaDB users to migrate to the proper “utf8mb4” charset using available conversion guides.
MariaDBMySQLcharacter encoding
0 likes · 7 min read

This article explains the concepts of characters, character sets, and character encoding, describes how computers store and render text using methods like ASCII, GB2312, Unicode, and UTF‑8/16/32, and discusses why garbled text occurs across different languages and systems.
UTF-8Unicodeascii
0 likes · 10 min read

This guide explains the essential character set encodings—ANSI, ASCII, GB2312/GBK/GB18030, Unicode planes, UTF‑16, UTF‑32, and UTF‑8—and shows how they are used in MFC and Qt, providing code examples to avoid garbled text in software.
ANSIMFCQt
0 likes · 8 min read

This article explains the fundamentals of character encoding, covering Unicode’s universal character set, the structure of its planes and surrogate areas, the variable‑length UTF‑8 and UTF‑16 encodings, Chinese‑specific GBK encoding, and practical iOS code examples for handling Unicode, emojis and regular‑expression based Chinese character detection.
GBKUTF-8Unicode
0 likes · 12 min read

This guide explains common character encodings such as ANSI, ASCII, GB2312/GBK/GB18030, Unicode, UTF‑8, UTF‑16, and UTF‑32, and shows how to handle them in MFC and Qt with practical code examples.
ANSIMFCQt
0 likes · 8 min read

This article explains how emojis are represented in Unicode, covering basic code points, variation selectors, skin‑tone modifiers, zero‑width joiners, flag ligatures, tag sequences and keycap symbols, and shows how JavaScript can correctly process them using grapheme‑cluster techniques.
Unicodecharacter encodingemoji
0 likes · 16 min read

This article curates essential front‑end resources covering character encoding fundamentals, mobile screen adaptation strategies, practical ES6 tricks, Pinia state‑management advantages over Vuex, classic Git operations for code merging, and crucial browser memory knowledge for stable web applications.
ES6Piniabrowser memory
0 likes · 4 min read

This article explains the fundamentals of character sets and encodings—including ASCII, GB2312, GBK, Unicode, UTF‑8, UTF‑16, and UCS‑2—shows how they affect JavaScript string length, emoji handling, and common pitfalls such as combining characters, endianness, and BOM issues.
JavaScriptUTF-8Unicode
0 likes · 31 min read

This article explains why MySQL's built‑in utf8 charset is not true UTF‑8, how inserting 4‑byte emoji characters triggers errors, and why switching the database, tables, and connection to utf8mb4 resolves the issue, along with a brief history of MySQL's encoding decisions.
character encodingemojiutf8mb4
0 likes · 9 min read

This article explains why MySQL's traditional utf8 charset cannot store 4‑byte characters such as emojis, demonstrates the resulting insert errors, and shows how switching the database, system, and column collations to utf8mb4 resolves the issue while also providing a brief history of MySQL's charset implementation.
MySQLSQLcharacter encoding
0 likes · 9 min read

This article explains why MySQL's default utf8 charset cannot store four‑byte characters like emojis, demonstrates the resulting insert errors, and shows how switching to the utf8mb4 charset resolves the issue while providing a brief history of MySQL's encoding decisions.
MySQLSQLcharacter encoding
0 likes · 8 min read

This article explains why MySQL’s legacy utf8 charset only supports three‑byte characters, causing emoji insertion failures, and shows how switching tables, columns, and the database to utf8mb4 resolves the issue while detailing the historical reasons behind MySQL’s limited utf8 implementation.
MySQLSQLcharacter encoding
0 likes · 9 min read

The article traces character encoding from early telegraph and Morse code through ASCII, ISO national sets and Chinese standards, explains Unicode’s unification and its UTF‑8/‑16/‑32 forms, and shows how modern languages—especially JavaScript—handle code points, highlighting the cultural and technical significance for developers.
JavaScriptUTF-16UTF-8
0 likes · 31 min read

This tutorial explains the origins and evolution of character encoding, covering early ASCII, Chinese GBK/GB18030, the universal Unicode standard, UTF‑8 variable‑length encoding, and practical differences between Python 2 and Python 3 with code examples.
GBKPythonUTF-8
0 likes · 9 min read

This article explains why Chinese characters become garbled on Windows when using Qt or Cocos2d‑x, explores ASCII, GBK, Unicode, UTF‑8 and ANSI encodings, shows how Visual Studio misdetects UTF‑8 files, and provides step‑by‑step solutions to eliminate the issue permanently.
CompilerQtString
0 likes · 13 min read

This article explains MySQL's character encoding workflow, illustrates why queries containing Chinese characters fail without proper settings, and shows how to configure JDBC URLs, server variables, and Docker‑based MySQL instances to ensure lossless UTF‑8 handling.
Database ConfigurationDockerJDBC
0 likes · 9 min read

This article walks through the evolution of character encoding—from the early ASCII standard, through Chinese extensions like GB2312 and GBK, to the universal Unicode system and its UTF‑32, UTF‑16, and UTF‑8 encodings—explaining their structures, usage, and common pitfalls.
GB2312JavaTomcat
0 likes · 12 min read

This article explains how computers store text using binary, introduces ASCII, Unicode and UTF‑8 encoding rules, discusses the limitations of C‑style null‑terminated strings, and describes Redis's Simple Dynamic String (SDS) data structure, its old and new versions, advantages, and related APIs.
C stringsRedisSDS
0 likes · 14 min read

This article explains the history and purpose of Unicode, describes how character sets differ from encodings, details the storage formats of UTF‑8, UTF‑16, and UTF‑32, discusses byte order and BOM, and shows common encoding pitfalls in Redis and MySQL with practical solutions.
MySQLUTF-16UTF-32
0 likes · 15 min read

This article traces the evolution from ASCII to Unicode, explains how Unicode defines universal code points, compares the UTF‑8, UTF‑16 and UTF‑32 encoding schemes, discusses byte order and BOM, and shows practical fixes for common encoding problems in Redis and MySQL.
MySQLRedisUTF-16
0 likes · 15 min read

This article explains the process by which keyboard input is transformed into ASCII codes, how input methods map those codes to proprietary encodings, the role of code pages and fonts in rendering characters, and the use of Unicode, BOM, and endianness when saving text files.
Unicodeasciicharacter encoding
0 likes · 3 min read

This article explains why the garbled string “锟斤拷” appears in Chinese software, covering basic character encoding concepts, the Unicode replacement character, UTF‑8 decoding failures, and how GBK’s double‑byte scheme turns the placeholder bytes into the visible characters 锟、斤、拷.
GBKUTF-8Unicode
0 likes · 4 min read

This article explains how character encoding works, using ASCII, Unicode, UTF‑8 and GBK examples to reveal why the garbled string “锟斤拷” appears when mismatched encodings are processed, and shows the underlying byte‑level transformations.
GBKUTF-8Unicode
0 likes · 4 min read

This article explains how the PHP mb_detect_order() function configures or retrieves the list of character encodings used for automatic detection, describes its parameters and return values, and provides practical code examples for both string and array inputs.
BackendPHPcharacter encoding
0 likes · 2 min read

The article explains why MySQL’s legacy “utf8” character set only supports three‑byte sequences, causing errors with genuine four‑byte UTF‑8 characters, and shows how the proper “utf8mb4” charset resolves the issue, including historical background, practical examples, and migration guidance.
MariaDBMySQLUnicode
0 likes · 10 min read

The article explains the process by which computers render characters, covering binary representation, character encoding standards such as Unicode and GBK, the role of input methods, font files, and the challenges posed by rare characters and system compatibility.
Input MethodsUnicodecharacter encoding
0 likes · 6 min read

This article explains how characters are turned into binary, mapped through Unicode and character sets, processed by input methods and font files, and finally rendered on screen, while also covering the challenges of rare characters and recent Unicode updates.
Input MethodsUnicodecharacter encoding
0 likes · 7 min read

This article explains the fundamentals of characters, character sets and encodings such as ASCII, GB2312, Unicode, UTF‑8/16/32, BOM, and demonstrates how Java, browsers, Tomcat and MySQL handle encoding conversion, endianness and string length issues with practical code examples.
BOMJavaMySQL
0 likes · 21 min read

The article explains why MySQL's legacy "utf8" charset only supports three‑byte characters, causing storage errors for true four‑byte UTF‑8 symbols, and advises developers to migrate all MySQL/MariaDB databases to the proper "utf8mb4" charset.
MariaDBMySQLcharacter encoding
0 likes · 7 min read

This article explains why a C# char literal like '\x1d11e' is illegal, how Unicode code points map to glyphs, the role of code pages on Windows and Linux, and practical tips to avoid encoding mishaps across different programming languages.
C++C++Java
0 likes · 8 min read

This article explains the fundamentals of character encoding, covering concepts such as information, symbols, character sets, various encoding schemes like ASCII, GB2312, UTF‑8, Unicode planes, common pitfalls, and practical examples to help developers avoid garbled text.
GB2312UTF-8Unicode
0 likes · 9 min read

This article explains the fundamentals of character encoding—from Morse‑code analogies and ASCII to Unicode, UTF‑8/UTF‑16/UTF‑32, and Chinese encodings like GB2312, GBK, and GB18030—illustrating how mismatched encodings cause garbled text and how to avoid them.
GBKUTF-8Unicode
0 likes · 10 min read


21CTOMay 13, 2019 · Databases
Discover why MySQL’s legacy ‘utf8’ charset only supports three‑byte characters, causing storage errors for true UTF‑8 data, and learn how switching to the proper ‘utf8mb4’ charset resolves these issues, with a brief history and practical migration guidance.
MariaDBMySQLUTF-8
0 likes · 7 min read

This article explains why MySQL’s legacy "utf8" charset only supports three‑byte characters, why it’s not true UTF‑8, and provides a clear guide to migrating databases to the proper "utf8mb4" charset for full Unicode support.
MariaDBMySQLUnicode
0 likes · 8 min read

This article explains the origins of character sets, the relationships among various encodings such as ASCII, GB2312, GBK, GB18030, Unicode, UTF-8, UTF-16, and UTF-32, and shows how JavaScript handles Unicode and emoji characters, including practical code examples and solutions for length‑limited input fields.
UTF-16UTF-8Unicode
0 likes · 11 min read

This guide explains why MySQL tables default to latin1, demonstrates how to check and change table, session, and global character set settings, and shows the necessary my.cnf configuration changes to permanently enable UTF‑8 support for storing Chinese characters.
ChineseDatabase ConfigurationMySQL
0 likes · 6 min read

This article explains the fundamental concepts of characters, character sets, and encodings, compares common encodings such as ASCII, Unicode, and UTF‑8, and shows how Python 2 and Python 3 handle default encodings, string types, and common Unicode errors with practical code examples.
Python2UTF-8Unicode
0 likes · 14 min read

This article introduces the fundamentals of character encoding and decoding, explains the difference between character sets and encodings, and demonstrates practical Node.js examples using the iconv‑lite library to correctly encode and decode Chinese text, helping developers prevent common garbled‑text issues.
GBKNode.jsUTF-8
0 likes · 7 min read

This article explains why encodeURIComponent can raise a URI malformed error, clarifies the concepts of high and low surrogate pairs, and provides a comprehensive overview of character sets, Unicode, and the UTF‑8 and UTF‑16 encodings used in JavaScript.
Frontend DevelopmentJavaScriptUTF-16
0 likes · 12 min read


ITPUBSep 19, 2016 · Fundamentals
This article explains the fundamentals of character encoding, covering the evolution from the 7‑bit ASCII standard to Chinese GB2312, the development of Unicode and UTF‑8, and provides practical guidance for handling these encodings in Windows and Linux C programs, including a sample UTF‑8 detection function.
GB2312UTF-8Unicode
0 likes · 13 min read


ITPUBApr 19, 2016 · Fundamentals
This article explains the fundamentals of character encoding, covering character sets, encoding rules, and common schemes such as ASCII, Unicode, UTF‑8, GB2312, GBK, and GB18030, helping developers prevent and resolve garbled text issues in web and database applications.
GBKUTF-8Unicode
0 likes · 10 min read


21CTOMar 31, 2016 · Databases
This article explains the multiple encoding/decoding steps MySQL performs when storing and retrieving data, identifies why mismatched character sets cause mojibake, and provides practical methods to avoid and repair corrupted text in MySQL tables.
MySQLcharacter encodingcharset conversion
0 likes · 17 min read

This article explains character sets and encodings, shows why MySQL data can become garbled, and provides step‑by‑step methods—including proper configuration, common pitfalls, and reliable repair techniques—to prevent and correct encoding issues such as emoji storage failures.
GBKMySQLUTF-8
0 likes · 24 min read


21CTOSep 29, 2015 · Fundamentals
This article explains why Chinese characters often appear as mojibake on Windows and Linux, introduces the history and technical details of ASCII, GB2312, GBK, GB18030 and Unicode, and provides concrete examples and command‑line tools for inspecting and converting file encodings.
GB2312UTF-8Unicode
0 likes · 26 min read


21CTOAug 14, 2015 · Fundamentals
This article explains how computers store and display characters using binary, defines character sets and encodings such as ASCII, GB2312, GBK, GB18030, BIG5 and Unicode, compares UTF‑8, UTF‑16, UTF‑32, and describes related HTTP headers like Accept‑Charset, Content‑Type, and Content‑Encoding.
CharsetGB18030HTTP headers
0 likes · 20 min read

This article explains the root causes of MySQL character‑set garbling, illustrates the encoding/decoding steps during data insertion and retrieval, and provides practical methods—including dump‑reload and binary conversion—to prevent and repair corrupted text.
MySQLSQLcharacter encoding
0 likes · 19 min read
