I aspire to forget even half the stuff this guy knows. Nick is insanely talented beyond my comprehension... and I have 20 years experience in programming.
I can't even wrap my head around trying to in-place rotate a bitmap in C without pulling my hair out. This guy must do it in his sleep.
Far far better than caca. But if you want a picture-perfect quality try instead mpv with a sixel output
The subset of usable characters (glyphs) roughly defines how accurate the picture can be represented: if all you have is - and _ and you want to represent an horizontal pipe, it'll be ugly.
Of course it's more complicated than that, but caca uses ascii, while chafa uses a larger unicode range.
The example is illustrated in picture on https://github.com/csdvrx/derasterize where the left is the original basicidea.c using only unicode halfblocks, and the right has more candidate of different shapes.
Derasterize lets you select the width of the range you want to use, to improve encoding time say for video - but ideally, you would be able to test that whatever font you are using contains the glyphs you want.
The few times I've ever used libcaca/mplayer to try and play videos, it was on Linux consoles with no working X server, or when I had broken the X server, or I was just amused to try it.
The thing about sixel is it's only supported on old DEC glass terminals, xterm with a non-default configuration, mintty, and several emulators that are fairly unlikely to be preinstalled anywhere. So I struggle to imagine a scenario outside of the novelty of playing video media in a terminal where you'd use sixel for playing video over either a dedicated streaming API (raw video stream, networked X, VNC, waypipe) or accessing media over a networked filesystem (e.g. sshfs, which I regularly use to watch videos).
Images are a different matter, where the compromise makes more sense. Juxtaposing images with terminal output is a nifty feature. But the (IMO limited) utility of programs like caca and chafa is being "universal enough" that I can write a script that vomits a jpeg to some vague common denominator standard and it'll probably work for all my coworkers using a smorgasbord of emulators.
> The thing about sixel is it's only supported on old DEC glass terminals, xterm with a non-default configuration, mintty, and several emulators that are fairly unlikely to be preinstalled anywhere
Uh, no?
Just start xterm (say from another xterm) with the correct flag.
Sixels are also supported on the BSD console.
The lack of support in the likes of gnome-terminal is a willful and ugly political decision that I've already documented.
> Images are a different matter, where the compromise makes more sense.
Indeed, I love to do remote gnuplots
> I can write a script that vomits a jpeg to some vague common denominator standard and it'll probably work for all my coworkers using a smorgasbord of emulators.
This is the idea of tmux-sixel https://github.com/csdvrx/sixel-tmux : intercept sixels sequences and, if your terminal doesn't support it (or if you use the scrollback buffer, to save or RAM), render a unicode representation instead (like Chafa), but if it does, pass through the original sixel sequence.
I'm not sure chafa works with video like, say, mplayer built with aalib and libcaca will convert movie files to color or B&W ASCII on the command line (iirc w/ audio only on the host machine). Similarly, on PPC Macs, there was QuickASCII,[1] which lacks audio. I have used tiv,[2] (available with MacPorts) which works very well with images, not video. There was a way to configure the browser links (not lynx) to use tiv to browse the web on cli with converted images.
Let's see you try that over ssh. The subject is command line graphics and video. What you have liked to is nothing of the sort, those are not terminal graphics but rather conventional GPU graphics and merely opening a graphic window within the command prompt on a local machine to play the video. Why bother to do that when you're sitting locally at the machine with access to the GUI and all the GUI media applications?
ffmpeg is a dependency of mplayer, but ffmpeg on it's own can't transcode or reinterpret video as ASCII. The reason for the exercise is only to show that video and graphics can be displayed on the command line within the limitations of the command line, namely, text only.
> What you have liked to is nothing of the sort and merely opening of a window within the command prompt on a local machine
I don't think you understand: sixels work IN BAND, meaning ssh will transmit the full video flux "after" it's converted into sixels (it's a little more complicated than that, but I'm trying to say don't expect a SYN/ACK outside of ssh own), which will then be rendered on the remote terminal into pictures upon reception.
It's just like doing 'cat' on a remote file: the content will be transmitted regardless, just at different speeds depending on your available bandwith
> Why bother to do that when you're sitting locally at the machine with access to all the GUI applications?
If you tried to transmit video using the sixel protocol over ssh, you will experience bandwidth issues and immediately fail.
>>What you have liked to is nothing of the sort and merely opening of a window within the command prompt on a local machine
>I don't think you understand: sixels work IN BAND, meaning ssh will transmit the full video flux after it's converted into sixels, which will then be rendered on the remote terminal into pictures upon reception. It's just like doing 'cat' on a remote file
This will not work.
"Sixel is broken because the emulation behavior depends on the font size, thus theoretically can't be supported by terminals that don't have the concept of pixel size (e.g. a detached tmux). Sixel is broken because it cannot be supported by tmux with side-by-side panes. Sixel's palette-based approach is also a terrible legacy, practically unable to transfer photos."[1]
> If you tried to transmit video using the sixel protocol over ssh, you will experience bandwidth issues and immediately fail.
Even abstracting away your incomplete understanding of how sixels work, have you considered the possibility I may have access to way more bandwidth than you? (and I most likely do)
> This will not work.
Yes it does.
I have written lots of sixel code (I've yet to see any of yours), tried to explain you the failure in your reasoning, yet you still don't believe me, then you deny the reality of my lived sixel experience with... a biased quote?
For sixels to be displayed, the terminal must have support for them, and most terminals don't support sixels, like Windows Terminal. xterm has some support, but only 16 colors. But xterm is otherwise an exceptionally feature-poor terminal. I don't think anyone uses xterm unless there is no other option.
While sixels are a very old standard, lack of significant adoption and a code base that is notoriously buggy means that more often than not, the ability to display sixels just isn't there, and on the rare occasion that it is, artifacts are extremely common.
ASCII, otoh, is supported by all terminals. Now, granted, no one wants to watch a video converted into text, but this isn't the point, which is merely a method to display something on the command line, and in the case of ASCII, every command line, every terminal, everywhere and always. mplayer is not dependent on the client, so any remote client can run it remotely from the server. sixel support is the opposite; the client must have support for sixels to be displayed.
> I'm not sure why people expose themselves to something as bad and ugly in this day and age.
> I don't think you understand
> Even abstracting away your incomplete understanding of how sixels work
> I have written lots of sixel code (I've yet to see any of yours)
> tried to explain you the failure in your reasoning
FWIW, all these arguments are ad hominem fallacies indicating invalid and otherwise faulty reasoning.
I don't doubt that it works, but last I checked, Sixel support wasn't very widespread (I don't use Windows) whereas ANSI support is near-universial in my experience. For higher resolution monochrome (good enough for graphs), you can use the 2x4 Braille Unicode glyphs [where supported].
If you want to see pictures in your terminal but don’t want to install something just for this, the kitty terminal can do it, including over an ssh connection.
Short of swapping in a new image during the vertical blanking interval, you will never have a "flicker" free image. Any "flicker" that can happen from no double buffer can happen because of no vsync. This begs the question why you would ever want to show graphics in the terminal in the first place. I might be wrong, but in my experience most terminal emulators do not look like they can update the full screen 60 times per second. If everyone started doing graphics in the terminal, we will have to find what method can actually output fast enough, or create it and standardize it, and soon we will have a new graphics API that all terminal emulators must conform to or not, and a way for applications to detect whether the terminal supports it.
I was hoping to see a more modern alternative to the VTE terminal protocol and its derivatives. Does anybody have any good suggestions and possible implementations?
The intention is to document them well enough that other terminal emulators can implement them (which some have).
Among those is a graphics protocol, which is actually (optionally) used by chafa. Another is a keyboard protocol extension: which has been implemented by a number of editors and other terminals: notably neovim, kakoune, helix, wezterm, and foot.
I was going for Mexican Spanish, but both interpretations work, cf. cramming symbols together into a lo-fi semblance of the input. Although this might not apply to the kitty/sixel/iterm modes, depending on how you look at it :-)
I'm learning spanish now and these language differences are confusing. My (mexican) girlfriend has (more than once) told me a word she thought meant one thing that ended up being an insult pretty much everywhere but Mexico.
[1] https://www.youtube.com/watch?v=dcjkezf1ARY