Questions tagged [encoding]

A method of representing characters (such as A, 9, %, ழ, ♦, and non-printing control characters) for storage and communication. The Unicode standard provides a code point (number) for each of over 100,000 different characters, and the standard is implemented by character encodings such as UTF-8, widely used in Linux systems. The first 128 Unicode code points are the ASCII characters, which UTF-8 represents with 1 byte per character.

Filter by
Sorted by
Tagged with
0 votes
0 answers
50 views

How can I force gedit 44.2 to open file in the UTF-8 encoding?

I'm on Ubuntu 23.10 using gedit 44.2. I opened a file named METADATA, and it displayed like this: However, if I open it with another file editor, I see these contents: Metadata-Version: 2.1 Name: ...
Flimm's user avatar
  • 41.8k
0 votes
0 answers
470 views

How to convert/encode video files with ffmpeg, using AMD Radeon hardware encoding

Good day, and thanks in advance for any help I am running Ubuntu 22.04 LTS on a PC with an AMD Ryzen 7 5700G CPU and AMD Radeon RX 6600 GPU. I have a large number of video files in MP4 format that I ...
Shmettie's user avatar
0 votes
0 answers
157 views

Fixing the wrong encoding of filenames

I have a Linode server running Ubuntu 22.04. When I log in through SSH and download files with "Sinhala" language in their names, they show up correctly in the terminal, and I can compress ...
John Snape's user avatar
0 votes
1 answer
138 views

Unable to open a text file created by exiftool: There was a problem opening the file; the file you opened has some invalid characters

I am facing this error when opening a text file in gedit on Ubuntu 22.04: The file was created as a redirection of the exiftool (12.57) command line for extracting metadata from a bunch of 100'000 ...
s.k's user avatar
  • 1,280
0 votes
0 answers
449 views

Display Chinese characters in SSH terminal

I need to install a package from GitHub (https://github.com/vaxilu/x-ui/) which is pure Chinese. I tried to install it on Ubuntu 22.04 but during installation it asks some questions and I can't use an ...
Omid Shojaee's user avatar
0 votes
0 answers
91 views

Filenames garbled and truncated when accessed through cifs mount

I have multiple machines all running Ubuntu 20.04, accessing a shared drive in the form of a Synology NAS. There appears to be a bug in the way character encoding is treated by one of the machines. ...
Euan Joblin's user avatar
0 votes
0 answers
187 views

Mismatched charset while executing application on Windows and Wine (Ubuntu)

We have a small exe client application that used for loading the scanned images from the remote sources, what we need to do is enter the address from the images to specific text box and submit. The ...
hungbv's user avatar
  • 1
0 votes
1 answer
284 views

Gnome ctrl-shift-u fails for a handful of unicode code points

Pressing ctrl-shift-u followed by some hexadecimal digits types a unicode character with the given code-point, for instance ctrl-shift-u 2266 gives ≦. Strangely, some unicode code points fail in my ...
Bruno Le Floch's user avatar
3 votes
2 answers
3k views

How to edit UTF-8 files with vim

How can I edit UTF-8 files with vim? There is a problem with german special characters like 'Ä', 'ü'. There are some in the comments. vim shows Ã~D instead of 'Ä' and ü instead of 'ü' then. (I hope ...
Andy A.'s user avatar
  • 133
0 votes
1 answer
262 views

How to use Ftfy

I have a xx.sql that has some encoding issues. eg: represent†in Xhosa) I was advised to use [ftfy to fix] (https://pypi.org/project/ftfy/) I have installed pip install ftfy but for the sake of me ...
Safejack's user avatar
1 vote
2 answers
1k views

How do I get rid of invalid characters in a plain-text file when using Gedit?

Problem Gedit says that one of my files using UTF-8 encoding has invalid characters, and may get corrupted if I continue to use it. Details The file in questions is my Someday/Maybe List. I usually ...
user avatar
0 votes
0 answers
161 views

FeatherPad limited encodings

I am testing the FeatherPad simple text editor. Ubuntu 20.10 provides version 0.12.1 of FeatherPad. On this version, I noticed that only a limited variety of text encodings are supported. Especially ...
FedKad's user avatar
  • 10.5k
2 votes
1 answer
770 views

What is the default encoding, used in text files in Ubuntu?

I created a normal text file "input.txt" in Ubuntu. I added some data to it. My questions are: What is the default encoding, used in text files in Ubuntu? How do I find its encoding ...
Krishna Kanth Yenumula's user avatar
2 votes
1 answer
1k views

Batch FFmpeg encoding - Variable CRF based on Bitrate

I use ffmpeg in a VM instance running Ubuntu to encode some videos I downloaded from various streaming sites to HEVC. Currently I use a bash script to convert all these files in a directory. Overall ...
Metallizer's user avatar
0 votes
1 answer
7k views

Change the cURL response encoding for some characters

The response of the below curl command is a json and it has some japanese characters which it is showing in utf-8. I can't share the url but this is how I am sending the request. curl https://some-...
Rajat Garg's user avatar
1 vote
3 answers
1k views

Ubuntu 20.04 installation gave my terminal all squares with 4 characters in them

After installation of Ubuntu 20.04 my terminal characters shifted to some kind of squares with hex codes in them. I am not able to find out how to get back to normal. Any suggestions?
Joachim's user avatar
  • 101
1 vote
1 answer
268 views

gedit showing wrong strange numeric characters after ubuntu upgrade

I was running ubuntu 19.04, then I used the dist upgrade gui to upgrade to 19.10. Then I did the same to upgrade to 20.04, which I'm currently running. I'm don't know if this started happening after ...
delki8's user avatar
  • 121
1 vote
1 answer
1k views

Lubuntu is not able to read file names with cyrillic characters

I would be grateful for helping in resolving the following issue. Cyrillic characters in file names are rendered with octal escape sequence codes in Konsole. For example, the file name Тест.txt is ...
S. N.'s user avatar
  • 315
0 votes
1 answer
249 views

Russian Cryrilic Italics Displayed Incorrectly

A few characters don't appear properly when in Italic, for example: The character that looks like a u with an accent should be й and the last alphabetic u (in bold and italics should be) и. Any ...
Kohjah Breese's user avatar
0 votes
1 answer
142 views

What program language is file '/usr/bin/apt-get' coded in? C or C++?

What programming language is the file /usr/bin/apt-get coded in? C or C++? I open the file 'apt-get' with encoding 'hex': 7f45 4c46 0201 0100 0000 0000 0000 0000 0300 3e00 0100 0000 6038 0000 ...
Ascending123's user avatar
3 votes
0 answers
155 views

Thunderbird unable to set Text Encoding to Turkish

I am using Ubuntu 19.10 and Thunderbird 68.4.1 (64-bit). I want to set the default Text Encoding for incoming mails to Turkish (ISO-8859-9). However, when I go to Preferences → Display → Formatting → ...
FedKad's user avatar
  • 10.5k
1 vote
0 answers
555 views

Can I encode videos using NVENC in Handbrake on Ubuntu 19.10?

I've just purchased an Nvidia GTX1050 card as my i7 3770 struggles to play HEVC files in Kodi. I'm wondering if it's possible to encode x264 to x265 using NVENC in Handbrake on Ubuntu as it is in ...
jnf1994's user avatar
  • 71
0 votes
1 answer
2k views

Graphic cards for Ubuntu 19.10 that support hardware encoding

I got a computer that came with a Radeon R7 240 Graphics card. I want to use the computer to livestream to youtube. (Not streaming games, just general discussions). I'm setting up OSB Studio and doing ...
Clay Carlino's user avatar
3 votes
1 answer
15k views

Convert string to UTF-8 with terminal only

How I can convert a string to UTF-8 encoding using Ubuntu terminal only?
Noman Maqsood's user avatar
1 vote
0 answers
261 views

emacs org-bullets not supported

I'm using ubuntu 19.04 with KDE5 org-bullets doesn't seem to work for me on both terminal mode as well as GUI mode. I tried it on a windows VM, it works fine there, but not in my linux machine. My ...
surjit's user avatar
  • 400
5 votes
2 answers
9k views

How enable GPU accelerated video encoders in FFMPEG, Ubuntu 19.04?

How enable HW accelrated encoding in FFMPEG, Ubuntu 19.04 ? (at least _nvenc variants of h.264/h.265 encoders) Do you know simplified user friendly way, how to do that using TASKSEL or similar ...
Jiří Doubravský's user avatar
4 votes
1 answer
767 views

How do I discover my current system encoding?

In QtCreator, they have something that looks like this: I changed the defualt encodring setting in an attempt to get my ide to display emojis, and now my system is really acting up. Including web ...
Anon's user avatar
  • 12.1k
2 votes
1 answer
2k views

Is there a way to change gedit encoding from UI?

I have a txt file that came to me from windows Gedit can't read it properly (cyrillic became garbage) So far I haven't found a way to make gedit read it by changing something from UI Gedit itself has ...
Noone AtAll's user avatar
0 votes
0 answers
36 views

Files that have first line containing a particular string

I have noticed that a lot of files on my Linux OS have first lines that contain ^?ELF^A^A^A@^ or some variation, at the very least many contain ^?ELF. What does ELF stand for and what is this type of ...
Adam Ledger's user avatar
2 votes
1 answer
5k views

How to fix broken encoding in Wine application without changing OS language?

The application I am talking about is Worms Armageddon (WA). I'm running it under wine. Consider the following sequence: switch Ubuntu GUI language to Russian (and restart session) switch Ubuntu ...
whyer's user avatar
  • 519
0 votes
1 answer
510 views

Why does `file -i` determines file encoding as ASCII, however it is UTF-8 actually in git repository

There are two cases, which i confused about: If newly created file contains only latin symbols, then file -i will show us-ascii. If newly created file contains only latin and cyrillic symbols, then ...
uptoyou's user avatar
  • 867
1 vote
1 answer
142 views

conky manager korean break

I installed conky manager in ubuntu 18.04. and, It pretty worked well and I costomized the color etc. But, Korean Letters are broken. how can I fix it?
dissolve's user avatar
  • 121
0 votes
1 answer
2k views

Unable to display a file encoded in ISO-8859-9 to the terminal

In short: How can I display a file to the terminal that is not encoded in UTF-8? Currently, I have a test file encoded in ISO-8859-9 and containing the following 12 characters: ğüşıöçĞÜŞİÖÇ The hex ...
FedKad's user avatar
  • 10.5k
3 votes
2 answers
1k views

w3m charset source_dump not working correctly

I am trying to use the following command but can't get the right output: $ w3m -dump_source google.com r���G��2�Ph��ү�f�� ����?�l���%Y:���c(�����������Y\��s8Ư| ��;����1ʹ��D��^�lK���٥r��\���Սk�V��Ϸv�...
Andrey Fugas's user avatar
1 vote
2 answers
16k views

Configuring console-setup, what to do?

I did a fresh install of Ubuntu 18.04 LTS on my laptop and while the updates were being installed a window popped up: Configuring console-setup Encoding to use on the console : UTF-8 And it has ...
shreekar's user avatar
0 votes
1 answer
2k views

Special characters doesn't show up properly

Every time when I download a subtitle with special characters like ă,ș and ț (Romanian special characters) my system convert the characters in ã,º and þ. If I try to replace the characters in gedit I ...
antiks's user avatar
  • 113
1 vote
0 answers
441 views

execute sh file with Russian or Chines Chars - Saved as UTF-8 or Unicode

I have a file which has some russian characters in it: #!/bin/sh sed -i "s/\bVAR1\b/Привет, как ты/g" file1.txt When I save this file I had to save this as UTF-8 or Unicode format as I have some ...
Venkatesan Sundar's user avatar
0 votes
0 answers
863 views

How Encode 10bit 1080p .mkv file to 10bit 720p .mkv using ffmpeg

How Encode 10bit 1080p .mkv file to 10bit 720p .mkv using ffmpeg. Can anyone provide the full command line from beginning to end with best quality and the least file size?
AKJ's user avatar
  • 11
0 votes
1 answer
722 views

Gnome-terminal and Xfce4-terminal with ISO-encoding needs special-character keys to be pressed twice

In a gnome-terminal as well as in a xfce4-terminal, when I change its character-encoding from standard UTF-8 (with 2 bytes for special-characters) to ISO-Latin 8859-15 (always 1 byte), the following ...
Fidelis's user avatar
  • 152
4 votes
1 answer
7k views

How to add Cyrillic in Ubuntu 18.04?

I have already installed Russian keyboard layout. In language support -> installed languages I already have Russian. But when I open text file with Cyrillic I have encoding problems. This files was ...
Eric Korolev's user avatar
3 votes
1 answer
14k views

Ubuntu display Chinese Characters - Encoding Issue

I'm running a Ubuntu 14.04 32 bit. I'm facing a strange problem displaying Chinese characters in terminal, files, MySQL terminal etc. The Chinese characters are displaying as ?????. After some ...
user3066279's user avatar
3 votes
0 answers
844 views

SSH Unicode language problem [closed]

I have a problem with text encoding on files. I use Putty to connect trough SSH, I have installed the chinese language pack correctly - zh_CN.gb2312 (Chinese Simplified), in the terminal using ...
John Marius's user avatar
3 votes
1 answer
2k views

gedit weird encoding of standard text file

This question wa also posted in this SO post. I have a standard text file that is shown perfect with cat: $ cat myfile.txt v0[shape = Mrecord, label = ""] When I use xxd to examine the exact line ...
OrenIshShalom's user avatar
2 votes
0 answers
273 views

Hebrew language in Ubuntu 16.04.4

I'm using 16.04.4 LTS (GNU/Linux 4.4.0-119-generic x86_64) with Xfce. I have Hebrew folder names that are shown with invalid encoding: How can I fix it?
Kfir's user avatar
  • 21
1 vote
0 answers
1k views

ALT + codes in USB barcode scanner get interpreted as characters

I have a Zebra 2D barcode scanner connected to Ubuntu14.04. The scanner is set up as a keyboard emulator. When it scans a 2D Barcode (QR code) it outputs the scanned string which contains a FNC1 ...
Mike Young's user avatar
1 vote
0 answers
77 views

GParted and character encoding problem

I recently installed GParted and a Server X on my machine. These installations are complete and are working fine. When I start GParted over SSH, there is a strange encoding problem. I attached a ...
Dreamsiix's user avatar
6 votes
1 answer
2k views

gedit error : "Unexpected error: Invalid byte sequence in conversion input"

I'm doing a research project in NLP. For that I have to analyze a unicode (Sinhala) text file of around 10mb and it opens in Google docs. But when I try to open it from gedit I'm getting this error ...
Thidasa Pankaja's user avatar
1 vote
0 answers
169 views

Greek table of Contents created with pdfmod

I'm using pdfmod to create a ToC for a pdf, with greek characters. Although when I edit it greek characters are shown properly, when I save it neither Okular nor any pdf viewer displays them properly. ...
Αλεκος Ζαζόπουλος's user avatar
1 vote
1 answer
938 views

Re-enconde mkv to mp4

my mkv file was originally encoded using following encoder: Lavf57.57.100 is it possible to reencode the same file without using it? Because I can't convert it to mp4, I get following error when I ...
Blurry Script's user avatar
18 votes
3 answers
8k views

Cannot delete/move files with special characters in file name

As you can see below the files have uncommon characters. Deleting them either in the terminal or Dolphin returns the error: No such file or directory Running ls -la on the directory gave me this ...
karjedavpalaa's user avatar