How Python 3 Solves String Encoding Issues – A Hands‑On Guide

Previously I introduced Unicode and UTF‑8 encoding theory and the string‑encoding issues in Python 2.

Below I demonstrate the same concepts in a Python 3 environment on both Windows and Linux to deepen understanding of string encoding.

Python 2 encoding declaration

In a Python 2 file the header often declares the character set, e.g.: # -*- coding: utf-8 -*- The interpreter uses this declaration to read Chinese characters correctly.

Python 3 default Unicode handling

Python 3 treats all strings as Unicode by default, so the explicit declaration and the u'' prefix are unnecessary. The encode() function can be called without errors.

Demonstration on Windows:

In the screenshot str1 is a Chinese string without the u prefix.

Demonstration on Linux:

On Linux the default locale is UTF‑8, unlike Python 2 where the default was ASCII.

Overall, Python 3 resolves the major string‑encoding problem that caused many errors in Python 2, making code simpler and more portable.