Questions tagged [encoding]

A method of representing characters (such as A, 9, %, ழ, ♦, and non-printing control characters) for storage and communication. The Unicode standard provides a code point (number) for each of over 100,000 different characters, and the standard is implemented by character encodings such as UTF-8, widely used in Linux systems. The first 128 Unicode code points are the ASCII characters, which UTF-8 represents with 1 byte per character.

Filter by
Sorted by
Tagged with
1
vote
1answer
87 views

How to edit UTF-8 files with vim

How can I edit UTF-8 files with vim? There is a problem with german special characters like 'Ä', 'ü'. There are some in the comments. vim shows Ã~D instead of 'Ä' and ü instead of 'ü' then. (I hope ...
0
votes
1answer
39 views

How to use Ftfy

I have a xx.sql that has some encoding issues. eg: represent†in Xhosa) I was advised to use [ftfy to fix] (https://pypi.org/project/ftfy/) I have installed pip install ftfy but for the sake of me ...
1
vote
2answers
259 views

How do I get rid of invalid characters in a plain-text file when using Gedit?

Problem Gedit says that one of my files using UTF-8 encoding has invalid characters, and may get corrupted if I continue to use it. Details The file in questions is my Someday/Maybe List. I usually ...
0
votes
0answers
16 views

How do I fix c++ code in text editor of my ubuntu?

How do I fix the £ and @ part of my c++ code in my text editor. Please help.enter image description here
0
votes
0answers
61 views

FeatherPad limited encodings

I am testing the FeatherPad simple text editor. Ubuntu 20.10 provides version 0.12.1 of FeatherPad. On this version, I noticed that only a limited variety of text encodings are supported. Especially ...
2
votes
1answer
168 views

What is the default encoding, used in text files in Ubuntu?

I created a normal text file "input.txt" in Ubuntu. I added some data to it. My questions are: What is the default encoding, used in text files in Ubuntu? How do I find its encoding ...
2
votes
1answer
867 views

Batch FFmpeg encoding - Variable CRF based on Bitrate

I use ffmpeg in a VM instance running Ubuntu to encode some videos I downloaded from various streaming sites to HEVC. Currently I use a bash script to convert all these files in a directory. Overall ...
0
votes
1answer
3k views

Change the cURL response encoding for some characters

The response of the below curl command is a json and it has some japanese characters which it is showing in utf-8. I can't share the url but this is how I am sending the request. curl https://some-...
1
vote
3answers
479 views

Ubuntu 20.04 installation gave my terminal all squares with 4 characters in them

After installation of Ubuntu 20.04 my terminal characters shifted to some kind of squares with hex codes in them. I am not able to find out how to get back to normal. Any suggestions?
1
vote
1answer
129 views

gedit showing wrong strange numeric characters after ubuntu upgrade

I was running ubuntu 19.04, then I used the dist upgrade gui to upgrade to 19.10. Then I did the same to upgrade to 20.04, which I'm currently running. I'm don't know if this started happening after ...
1
vote
1answer
384 views

Lubuntu is not able to read file names with cyrillic characters

I would be grateful for helping in resolving the following issue. Cyrillic characters in file names are rendered with octal escape sequence codes in Konsole. For example, the file name Тест.txt is ...
0
votes
1answer
73 views

Russian Cryrilic Italics Displayed Incorrectly

A few characters don't appear properly when in Italic, for example: The character that looks like a u with an accent should be й and the last alphabetic u (in bold and italics should be) и. Any ...
0
votes
1answer
62 views

What program language is file '/usr/bin/apt-get' coded in? C or C++?

What programming language is the file /usr/bin/apt-get coded in? C or C++? I open the file 'apt-get' with encoding 'hex': 7f45 4c46 0201 0100 0000 0000 0000 0000 0300 3e00 0100 0000 6038 0000 ...
3
votes
0answers
117 views

Thunderbird unable to set Text Encoding to Turkish

I am using Ubuntu 19.10 and Thunderbird 68.4.1 (64-bit). I want to set the default Text Encoding for incoming mails to Turkish (ISO-8859-9). However, when I go to Preferences → Display → Formatting → ...
1
vote
0answers
408 views

Can I encode videos using NVENC in Handbrake on Ubuntu 19.10?

I've just purchased an Nvidia GTX1050 card as my i7 3770 struggles to play HEVC files in Kodi. I'm wondering if it's possible to encode x264 to x265 using NVENC in Handbrake on Ubuntu as it is in ...
0
votes
1answer
1k views

Graphic cards for Ubuntu 19.10 that support hardware encoding

I got a computer that came with a Radeon R7 240 Graphics card. I want to use the computer to livestream to youtube. (Not streaming games, just general discussions). I'm setting up OSB Studio and doing ...
2
votes
1answer
5k views

Convert string to UTF-8 with terminal only

How I can convert a string to UTF-8 encoding using Ubuntu terminal only?
1
vote
0answers
135 views

emacs org-bullets not supported

I'm using ubuntu 19.04 with KDE5 org-bullets doesn't seem to work for me on both terminal mode as well as GUI mode. I tried it on a windows VM, it works fine there, but not in my linux machine. My ...
4
votes
2answers
5k views

How enable GPU accelerated video encoders in FFMPEG, Ubuntu 19.04?

How enable HW accelrated encoding in FFMPEG, Ubuntu 19.04 ? (at least _nvenc variants of h.264/h.265 encoders) Do you know simplified user friendly way, how to do that using TASKSEL or similar ...
4
votes
1answer
370 views

How do I discover my current system encoding?

In QtCreator, they have something that looks like this: I changed the defualt encodring setting in an attempt to get my ide to display emojis, and now my system is really acting up. Including web ...
1
vote
1answer
607 views

Is there a way to change gedit encoding from UI?

I have a txt file that came to me from windows Gedit can't read it properly (cyrillic became garbage) So far I haven't found a way to make gedit read it by changing something from UI Gedit itself has ...
0
votes
0answers
27 views

Files that have first line containing a particular string

I have noticed that a lot of files on my Linux OS have first lines that contain ^?ELF^A^A^A@^ or some variation, at the very least many contain ^?ELF. What does ELF stand for and what is this type of ...
1
vote
1answer
2k views

How to fix broken encoding in Wine application without changing OS language?

The application I am talking about is Worms Armageddon (WA). I'm running it under wine. Consider the following sequence: switch Ubuntu GUI language to Russian (and restart session) switch Ubuntu ...
0
votes
1answer
116 views

Why does `file -i` determines file encoding as ASCII, however it is UTF-8 actually in git repository

There are two cases, which i confused about: If newly created file contains only latin symbols, then file -i will show us-ascii. If newly created file contains only latin and cyrillic symbols, then ...
1
vote
1answer
86 views

conky manager korean break

I installed conky manager in ubuntu 18.04. and, It pretty worked well and I costomized the color etc. But, Korean Letters are broken. how can I fix it?
0
votes
1answer
756 views

Unable to display a file encoded in ISO-8859-9 to the terminal

In short: How can I display a file to the terminal that is not encoded in UTF-8? Currently, I have a test file encoded in ISO-8859-9 and containing the following 12 characters: ğüşıöçĞÜŞİÖÇ The hex ...
3
votes
2answers
811 views

w3m charset source_dump not working correctly

I am trying to use the following command but can't get the right output: $ w3m -dump_source google.com r���G��2�Ph��ү�f�� ����?�l���%Y:���c(�����������Y\��s8Ư| ��;����1ʹ��D��^�lK���٥r��\���Սk�V��Ϸv�...
0
votes
1answer
3k views

Configuring console-setup, what to do?

I did a fresh install of Ubuntu 18.04 LTS on my laptop and while the updates were being installed a window popped up: Configuring console-setup Encoding to use on the console : UTF-8 And it has ...
0
votes
1answer
1k views

Special characters doesn't show up properly

Every time when I download a subtitle with special characters like ă,ș and ț (Romanian special characters) my system convert the characters in ã,º and þ. If I try to replace the characters in gedit I ...
1
vote
0answers
277 views

execute sh file with Russian or Chines Chars - Saved as UTF-8 or Unicode

I have a file which has some russian characters in it: #!/bin/sh sed -i "s/\bVAR1\b/Привет, как ты/g" file1.txt When I save this file I had to save this as UTF-8 or Unicode format as I have some ...
0
votes
0answers
651 views

How Encode 10bit 1080p .mkv file to 10bit 720p .mkv using ffmpeg

How Encode 10bit 1080p .mkv file to 10bit 720p .mkv using ffmpeg. Can anyone provide the full command line from beginning to end with best quality and the least file size?
0
votes
1answer
438 views

Gnome-terminal and Xfce4-terminal with ISO-encoding needs special-character keys to be pressed twice

In a gnome-terminal as well as in a xfce4-terminal, when I change its character-encoding from standard UTF-8 (with 2 bytes for special-characters) to ISO-Latin 8859-15 (always 1 byte), the following ...
3
votes
1answer
5k views

How to add Cyrillic in Ubuntu 18.04?

I have already installed Russian keyboard layout. In language support -> installed languages I already have Russian. But when I open text file with Cyrillic I have encoding problems. This files was ...
2
votes
1answer
8k views

Ubuntu display Chinese Characters - Encoding Issue

I'm running a Ubuntu 14.04 32 bit. I'm facing a strange problem displaying Chinese characters in terminal, files, MySQL terminal etc. The Chinese characters are displaying as ?????. After some ...
3
votes
0answers
560 views

SSH Unicode language problem [closed]

I have a problem with text encoding on files. I use Putty to connect trough SSH, I have installed the chinese language pack correctly - zh_CN.gb2312 (Chinese Simplified), in the terminal using ...
2
votes
1answer
978 views

gedit weird encoding of standard text file

This question wa also posted in this SO post. I have a standard text file that is shown perfect with cat: $ cat myfile.txt v0[shape = Mrecord, label = ""] When I use xxd to examine the exact line ...
2
votes
0answers
180 views

Hebrew language in Ubuntu 16.04.4

I'm using 16.04.4 LTS (GNU/Linux 4.4.0-119-generic x86_64) with Xfce. I have Hebrew folder names that are shown with invalid encoding: How can I fix it?
1
vote
0answers
863 views

ALT + codes in USB barcode scanner get interpreted as characters

I have a Zebra 2D barcode scanner connected to Ubuntu14.04. The scanner is set up as a keyboard emulator. When it scans a 2D Barcode (QR code) it outputs the scanned string which contains a FNC1 ...
1
vote
0answers
70 views

GParted and character encoding problem

I recently installed GParted and a Server X on my machine. These installations are complete and are working fine. When I start GParted over SSH, there is a strange encoding problem. I attached a ...
6
votes
1answer
1k views

gedit error : "Unexpected error: Invalid byte sequence in conversion input"

I'm doing a research project in NLP. For that I have to analyze a unicode (Sinhala) text file of around 10mb and it opens in Google docs. But when I try to open it from gedit I'm getting this error ...
1
vote
0answers
100 views

Greek table of Contents created with pdfmod

I'm using pdfmod to create a ToC for a pdf, with greek characters. Although when I edit it greek characters are shown properly, when I save it neither Okular nor any pdf viewer displays them properly. ...
1
vote
1answer
781 views

Re-enconde mkv to mp4

my mkv file was originally encoded using following encoder: Lavf57.57.100 is it possible to reencode the same file without using it? Because I can't convert it to mp4, I get following error when I ...
17
votes
3answers
5k views

Cannot delete/move files with special characters in file name

As you can see below the files have uncommon characters. Deleting them either in the terminal or Dolphin returns the error: No such file or directory Running ls -la on the directory gave me this ...
2
votes
1answer
407 views

When I redirect Maven commands, the file looks wrongly encoded

When I run a Maven command, it's normal in the terminal. But there is a problem when I redirect the output to a file like this: mvn install > file.log When I open the file, I see: [[1;34mINFO[m] ...
2
votes
0answers
1k views

How to fix utf8 in terminal?

I have a fresh installation of Xenial server inside a Virtualbox. While installing, I chose “No Localisation” and “C” as the default language. Now less thinks every file with non-Latin alphabet is a ...
1
vote
1answer
312 views

Using the tr command with character ranges

For the past few months, I've been learning about the command line with the help of William E. Shotts' The Linux Command Line. The Linux Command Line remains a popular book for newbies who would like ...
1
vote
1answer
6k views

How to scale and add watermark (overlay) in one command?

i want to encode video with watermark at once. but I am confused how to unify the video command and its watermark command encode video: ffmpeg -i video.mp4 -tune psnr -refs 3 -c: v libx265 -preset ...
2
votes
1answer
5k views

Texmaker asks about document encoding everytime I open a document

Every time I open a document in Texmaker it says: It seems that this file cannot be correctly decoded with the default encoding setting (UTF-8). Use this encoding: and it suggests ISO-8859-1 ...
3
votes
1answer
617 views

How can I know the encoding Gedit assumes for a given file?

It appears that there are at least two questions here on Ask Ubuntu that are similar to this, but neither has been answered. How can I find out the encoding method that gedit uses to open a text file?...
0
votes
2answers
1k views

How can I make my terminal display non-standard characters?

I am working on some UTF-8 text files whose content is in another language. Most of the text displays correctly, but some characters show up like this: <U+200C> How can I make my terminal ...