<div dir="ltr">Lately vim seems too smart for its own good.<div><br></div><div>I installed ed to work with special characters lately, and it shows them as a sequence of bytes. I thought that "-C" would cause vim to show a sequence of bytes in compatibility mode, but it still shows a spade in the example below.</div><div><br></div><div>Often, "sed -l filename" is handy. It uses the same "l" command for "listing" that ed supports. Note the "1l" command below, which means, "Go to line one and print a listing."</div><div><br></div><div><div>bash$ python3 -c "print('\u2660')" > spade.txt</div><div>bash$ vi !$</div><div>vi spade.txt</div><div>bash$ vi -C spade.txt </div><div>bash$ ed !$</div><div>ed spade.txt</div><div>4</div><div>1l</div><div>\342\231\240$</div><div>q</div><div>bash$ </div></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jun 2, 2017 at 3:01 PM, Lightner, Jeffrey <span dir="ltr"><<a href="mailto:JLightner@dsservices.com" target="_blank">JLightner@dsservices.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div class="m_333368666377217076WordSection1">
<p class="MsoNormal">The internet has a thousand posts saying “:set list” will show hidden characters.
<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">However that is NOT showing characters I know to be in the file:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">If I do a “cat” with no flags on a file it contains a line (obfuscated to protect the guilty) like this:<u></u><u></u></p>
<p class="MsoNormal">ORDER_HEADER|OBFUSCATE|#######<wbr>####|##########|USD|OBFUSCATE|<wbr>AA||OBFUSCATE|#### OBFUSCATE PARKWAY|OFUSCATE ### SUITE ###||ATLANTA|GA|#####|###|####<wbr>##|<a href="mailto:USER@ADDRESS.COM" target="_blank">USER@ADDRESS.COM</a>|FIRST LAST |### OBFUSCATE PLACE ||CITY||ST|US||#####|###<wbr>#######|<a href="mailto:USER@ANOTHERADDRESS.COM" target="_blank">USER@ANOTHERADDRESS.<wbr>COM</a><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">The key field being: <br>
|### OBFUSCATE PLACE |<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">If I run “cat –vt” on the file to show special characters and tabs I can see that field actually has extra hidden characters in it:<br>
|### OBFUSCATE PLACEM-BM- |<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">If I do vim of the file the field appears as it did in cat without the “-vt” flags.
<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">If I do “:set list” it shows me other characters (e.g. $ for each end of line) but does NOT show the extra characters seen for the above field that I see with “cat –vt”).
<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">How do I get vim to show the same characters in the field that I see with “cat –vt”?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">When I ran “file” on this file it says it is “UTF-8 Unicode text” whereas usually files of this type (without the special characters) simply show they are “ASCII text”. Presumably it is the special characters in this one that make it
appear as UTF-8. Doing :set options to change encoding to utf8 does NOT show the characters either.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p style="font-size:10pt;line-height:10pt;font-family:'Arial','times roman',serif">
CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information
is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message in error, and delete it. Thank you
</p>
<span>
<p></p>
</span><br>
<br>
<div></div>
</div>
<br>______________________________<wbr>_________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/<wbr>listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/<wbr>listinfo</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"> Ed Cashin <<a href="mailto:ecashin@noserose.net" target="_blank">ecashin@noserose.net</a>></div></div>
</div>