Questions tagged [utf-8]

Utf-8 is a form of character encoding that can represent every Unicode character available. It is the standard form of character encoding for the web and is also the standard in Ubuntu. It is set in a user's environment; an example for the British locale is en_GB.UTF-8.

Filter by
Sorted by
Tagged with
0
votes
1answer
71 views

Problem with wrongly displayed accented letters

I'm using Kubuntu 20.04 and I'm having problems with the display of accented letters and some other special characters. In particular french accented letters are displayed as Cyrillic characters and ...
0
votes
1answer
89 views

Adding a Google account via GNOME returns an error

I've been attempting to connect my school Google Drive account to my computer (I'm connected via my personal email). Here are the steps: Click on Google in the Online Accounts tab Type in my email ...
0
votes
1answer
67 views

How to connect to a share with support for UTF-16

I am having issues with an Ubuntu VM I have on QNAP NAS in mounting drives to it. I can mount the drive, but it only mounts as UTF-8 so many files I have aren't read properly by Deluge Bittorrent, ...
0
votes
0answers
20 views

KeePassXC doesn't recognize accented characters

I installed KeePassXC (v2.6.2) from snap and I'm unable to enter characters like ä, ö, â, etc. I can use these characters just fine everywhere else. Is there a setting I need to change to get accented ...
19
votes
2answers
3k views

Why is character “£” in a string interpreted strange in the command cut?

I'm developing a bash script and came up with the following strange behaviour! $ echo £ |cut -c 1 � The sign £ is passed to the next command cut whose filter is picking one character only. When I ...
0
votes
1answer
178 views

Getting error “pathname cannot be converted from utf-8 to current locale” while extracting a zip file in ubuntu 20.04

When I am trying to unzip a file "Desktop.zip" I am getting below error as shown in figure: I have made this zip file in ubuntu 20.04. Then downgraded to 18.04 and tried to unzip here. I am ...
2
votes
1answer
42 views

Why do Filenames created under UTF-8 not match the UTF-Codepage layout?

According to Wikipedia's utf-8 Codepage Layout, its character-set is as follows: ! " # $ % & ' ( ) * + , - . / 0-9 : ; < = > ? @ A-Z [ \ ] ^ _ ` a-z { | } ~ But (excepting /), ...
0
votes
0answers
171 views

django.db.utils.OperationalError: (1366, “Incorrect string value: '\\xD9\\x88\\xDB\\x95\\xD8\\xB3…' for column 'name' at row 1”)

hi i created a django project and tried to deploy it on ubuntu apache server with mysql database but when i run python3 manage.py migrate i get this error : django.db.utils.OperationalError: (1366, &...
1
vote
0answers
60 views

locales (UTF-8) are not set as expected

Ubuntu 16.04.6 LTS is installed on my virtual machine. When I use PuTTY to login, I get the following output: karsten@v38xxx:~$ who am i karsten pts/0 Jun 26 10:14 (87.175.23.xx) karsten@...
0
votes
3answers
332 views

'utf-8' codec can't decode byte 0xed when running sudo update-command-not-found

As the question above, when I try to run sudo update-command-not-found, I get this error Traceback (most recent call last): File "/usr/sbin/update-command-not-found", line 26, in <module> ...
0
votes
0answers
37 views

Search chinese characters from mysql database

I have stored the chinese characters in database like follow. {"zh":"\u6df1\u5165\u4e86\u89e3\uff0c\r\n\u7d55\u4f73\u5564\u9152\u8207\u7f8e\u5473\u98df\u7269 \u80cc\u5f8c\u7684\u6211\u5011\uff01","en"...
0
votes
0answers
65 views

Strange text formatting in Ubuntu console window

Right now I'm running a server on Ubuntu 18.04, and using PM2 to manage my programs. PM2 is supposed to display lots of information in neat tables like these. Instead, I get this. What's wrong with ...
0
votes
0answers
54 views

UTF-8 Issue, don't know where

$ sudo locale-gen de_DE.UTF-8 /bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8) Generating locales (this might take a while)... de_DE.UTF-8...cannot open locale definition ...
1
vote
1answer
3k views

Convert string to UTF-8 with terminal only

How I can convert a string to UTF-8 encoding using Ubuntu terminal only?
1
vote
0answers
106 views

emacs org-bullets not supported

I'm using ubuntu 19.04 with KDE5 org-bullets doesn't seem to work for me on both terminal mode as well as GUI mode. I tried it on a windows VM, it works fine there, but not in my linux machine. My ...
1
vote
0answers
46 views

Analyzing Characters in Ubuntu

I need a tool that can tell me the character encodings of each visible and invisible character from a range of characters I highlight within its editor. For example, a line break is usually \n in ...
1
vote
2answers
510 views

Find unicode by its code via grep

How find a symbol by code of Unicode? E.g. try find a space ('\u20' or '\u0020') in the second line: echo -e "u20\n \nfoo" |grep "\u20" - found the literal u20, not the space line. echo -e "x20\n \...
1
vote
1answer
124 views

UnicodeDecodeError error when starting Software Properties GTK Ubuntu 18.04

There is an issue when I try to launch software-properties-gtk on Ubuntu 18.04. Nothing happens when launching via desktop icon, and via terminal this error comes out: root:~# software-properties-gtk ...
0
votes
1answer
105 views

Why does `file -i` determines file encoding as ASCII, however it is UTF-8 actually in git repository

There are two cases, which i confused about: If newly created file contains only latin symbols, then file -i will show us-ascii. If newly created file contains only latin and cyrillic symbols, then ...
0
votes
1answer
368 views

Gnome-terminal and Xfce4-terminal with ISO-encoding needs special-character keys to be pressed twice

In a gnome-terminal as well as in a xfce4-terminal, when I change its character-encoding from standard UTF-8 (with 2 bytes for special-characters) to ISO-Latin 8859-15 (always 1 byte), the following ...
1
vote
0answers
192 views

Why temp txt files are created in ANSI?

I have a big log file and i need to cut a part of it and paste it in the end of the same file... so i created a script that looks for the chunks of code i need (sed) create a temp file ,paste it , ...
2
votes
1answer
7k views

Ubuntu display Chinese Characters - Encoding Issue

I'm running a Ubuntu 14.04 32 bit. I'm facing a strange problem displaying Chinese characters in terminal, files, MySQL terminal etc. The Chinese characters are displaying as ?????. After some ...
0
votes
1answer
111 views

How to scan internal memory of my Android phone around a certain index entry in order to find lost utf-8/LF (for Linux/Adroid) text?

Last night, I was using the Jota Text Editor app on my LG G3 Anroid phone running Fulmics. The phone (which I am planning to replace very soon) crashed about two times whilst I was writing a text with ...
0
votes
0answers
209 views

Problem Regarding display of Devanagari in ubuntu [duplicate]

I am able to see Hindi pretty much.But, Issue is related to display of some particular characters, Which are not displayed by Ubuntu. Not displaying doesn't mean that they are displaying by box, It ...
2
votes
0answers
895 views

Unicode/UTF-8 problems in ssh session with Ubuntu Server 16.04

I have a fresh Ubuntu Server 16.04 installation, and I am now testing how it handles unicode characters: I have a file name with a unicode character in it: testā.txt. If I pick up it with a tab, ie $ ...
1
vote
2answers
364 views

Locale problem in 17.10 after upgrade

I'm using Kubuntu 17.10 (fully updated). This problem may have been introduced during the upgrade to 17.04 or 17.10; I can't be sure, since I did both upgrades back to back. Everything works as ...
2
votes
0answers
1k views

How to fix utf8 in terminal?

I have a fresh installation of Xenial server inside a Virtualbox. While installing, I chose “No Localisation” and “C” as the default language. Now less thinks every file with non-Latin alphabet is a ...
0
votes
0answers
906 views

What is the correct way to set locale on server?

On my development machine (a vagrant box with ubuntu) with a php application runnning I have one language with swedish: sv_SE.utf8 And I'm setting the locale with this function - setlocale(...
0
votes
0answers
208 views

Some 2-byte Unicode characters appear as 2 characters in nano

I'm creating a web site in Russian. When I open HTML pages in nano on the remote server, some (but not all) of the Cyrillic characters appear as 2 characters: For example, the phrase "Welcome" ...
0
votes
1answer
116 views

Very strange behaviour of the Compose Key [closed]

In about 5 years of using Ubuntu, I could never the Compose Key to behave as I wanted despite a few attempts. Until Ubuntu 16.04 the Compose Key gave me the characters "œ", "Œ", "…" and "ğ" so I was ...
0
votes
2answers
1k views

How can I make my terminal display non-standard characters?

I am working on some UTF-8 text files whose content is in another language. Most of the text displays correctly, but some characters show up like this: <U+200C> How can I make my terminal ...
2
votes
1answer
941 views

UTF-8 Telugu text not rendering correctly in terminal

I am trying to process telugu text with Python. Text is rendering correctly in chrome browser like this. Unfortunately it is not rendering correctly in default terminal or python shell in terminal....
3
votes
0answers
2k views

Windows 10 oh my zsh fonts not working

I recently did the Windows 10 bash and changed my shell to zsh. When I run the themes my font encoding isn't working. I checked a couple things, installed the powerline fonts and have looked at this: ...
0
votes
1answer
188 views

How to get ssh under xterm not to break alt key?

I have started running in an Ubuntu 16 VM, running tigervnc 1.7.0, and run into an odd environment. Local windows behave as expected when I use alt-, for instance in a shell to back up a word via alt-...
29
votes
3answers
63k views

How can I see which encoding is used in a file

I had some problems with subtitle files in video omxplayer. To solve it I had to convert from windows-1250 to UTF-8 encoding. My question is, how can I see for some specific file which encoding is ...
0
votes
0answers
272 views

Convert java utf-8 string(one symbol) to ubuntu x11 Keysym

I'm writing an app that sends key presses from android's virtual keyboard to to some client. Currently I'm implementing the Ubuntu client, sending fake x11 input events. I have a problem converting ...
3
votes
1answer
863 views

Problem Ubuntu putting out characters in both UTF-8 and ISO-8859-1

I use PuTTY to connect to my Xubuntu system. When I set the translation to UTF-8 the fancy output from systemd looks fine but a ncurses application show up oddly. When I set the translation in PuTTY ...
1
vote
0answers
143 views

Text document unreadable after sudden PC shutdown

I was working in a text document with Mousepad, when I accidentally disconnected the power cable, shutting down the computer. When I started my Xubuntu session again, I tried to open the document, but ...
1
vote
1answer
4k views

grep regex .* not matching everything

I've recently gotten into using tools like grep, wc, cat, etc. because I have to deal with some very large CSV files (>10GB) which aren't quite delimited correctly (for instance, having occurrences of ...
0
votes
1answer
3k views

Mass-change encoding of files/directories

For some reason many files/directories on my server are not UTF-8 encoded. Is there a way I can change these files so they are utf-8? The majority of files on the server are UTF-8. Is there a way I ...
1
vote
1answer
442 views

Special characters in terminal

I am trying to set a metadata copyright notice using exiftool with exiftool -copyright="©2016 Jim Berry" *.JPG but it comes out in the images as "Copyright=©2016 Jim Berry" Why the "Â" and how ...
5
votes
2answers
3k views

Can gedit create a Unicode file?

Using bless I can see my gedit output is ASCII. Can gedit process some kind of Unicode?
3
votes
0answers
405 views

Guake won't display UTF-8 after forced reboot

That's basically it. Sometimes after having to force a reboot Guake won't show any UTF-8 characters. This is especially noticeable since I'm using powerline with a patched font. output from dpkg -l | ...
1
vote
0answers
44 views

Weird characters on Some Aplication Menu (ubuntu 14.04)

I get weird characters on some application menu. See screenshot. I haven't seen this happen. What do you think, what's the problem? and How to fix it? Thanks Libre Office and VLC weird menu ...
1
vote
1answer
3k views

How do I get a Japanese keymap?

I have selected the Japanese keymap in the text entry settings. But when I bring up the keymap diagram it shows only Roman characters. When I type, it is also not Hiragana, only Roman characters. I ...
4
votes
1answer
727 views

Disable U+00A0 no-break space (custom keyboard setting)

I'm using Ubuntu 14.04 on a Mac and use Eclipse and EiffelStudio for programming. My keyboard layout is set to "German (Switzerland, Macintosh)" which I would like to keep because I'm familiar with ...
2
votes
1answer
1k views

Can't change locale

I've been struggling to make this software Anki work and it keeps saying: Traceback (most recent call last): File "/usr/bin/anki", line 5, in <module> import aqt File "/usr/share/...
6
votes
3answers
12k views

How to read ANSI encoded files in the right way?

I have some files that Ubuntu can't read it ( ANSI encoding ) but Windows can read it well. When I open it in gedit or notepad++ it seems like this : Êã ÇáÊÍæíá áÜÜ How can I make Ubuntu read ...
1
vote
1answer
104 views

Displaying non Roman characters in Ubuntu Touch

Not sure whether someone already asked this question before, but I failed to get any in AskUbuntu search and on google search. I bought a Ubuntu Edition Meizu phone recently. But it is not ...
2
votes
0answers
1k views

Why doesn't my terminal display this character?

I like to run emacs in terminal, which is rxvt-unicode-256color. In the terminal my /etc/i3status.conf displays this: However, when I run emacs outside of my terminal the same file is displayed like ...