<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The maddening thing was that for one user IT was displaying a special character in vim albeit a bit different than “cat –vt”<br>
<br>
|### OBFUSCATE PLACEÂ |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The UTF8 triggered my memory – long ago I’d changed PuTTY to use the UTF8 character set as it displayed many things oddly otherwise for Linux systems. I just
modified my PuTTY to instead use translation “ISO-8859-1:1998 (Latin-1, West Europe)” which is what I think it had by default before I changed to UTF8. Sure enough after doing that I see the same thing as that other user had seen. It explains why he saw
that even without doing “:set list” but I still don’t understand why UTF8 isn’t showing me SOMETHING is there.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> ale-bounces@ale.org [mailto:ale-bounces@ale.org]
<b>On Behalf Of </b>Ed Cashin<br>
<b>Sent:</b> Friday, June 02, 2017 3:27 PM<br>
<b>To:</b> Atlanta Linux Enthusiasts<br>
<b>Subject:</b> Re: [ale] vim set list not showing special characters seen with cat -vt<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Lately vim seems too smart for its own good.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I installed ed to work with special characters lately, and it shows them as a sequence of bytes. I thought that "-C" would cause vim to show a sequence of bytes in compatibility mode, but it still shows a spade in the example below.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Often, "sed -l filename" is handy. It uses the same "l" command for "listing" that ed supports. Note the "1l" command below, which means, "Go to line one and print a listing."<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">bash$ python3 -c "print('\u2660')" > spade.txt<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">bash$ vi !$<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">vi spade.txt<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">bash$ vi -C spade.txt <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">bash$ ed !$<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">ed spade.txt<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">4<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">1l<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">\342\231\240$<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">q<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">bash$ <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Fri, Jun 2, 2017 at 3:01 PM, Lightner, Jeffrey <<a href="mailto:JLightner@dsservices.com" target="_blank">JLightner@dsservices.com</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The internet has a thousand posts saying “:set list” will show hidden characters.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">However that is NOT showing characters I know to be in the file:<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If I do a “cat” with no flags on a file it contains a line (obfuscated to protect the guilty) like this:<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">ORDER_HEADER|OBFUSCATE|###########|##########|USD|OBFUSCATE|AA||OBFUSCATE|#### OBFUSCATE PARKWAY|OFUSCATE ### SUITE ###||ATLANTA|GA|#####|###|######|<a href="mailto:USER@ADDRESS.COM" target="_blank">USER@ADDRESS.COM</a>|FIRST
LAST |### OBFUSCATE PLACE ||CITY||ST|US||#####|##########|<a href="mailto:USER@ANOTHERADDRESS.COM" target="_blank">USER@ANOTHERADDRESS.COM</a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The key field being:
<br>
|### OBFUSCATE PLACE |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If I run “cat –vt” on the file to show special characters and tabs I can see that field actually has extra hidden characters in it:<br>
|### OBFUSCATE PLACEM-BM- |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If I do vim of the file the field appears as it did in cat without the “-vt” flags.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If I do “:set list” it shows me other characters (e.g. $ for each end of line) but does NOT show the extra characters seen for the above field that I see with “cat –vt”).
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">How do I get vim to show the same characters in the field that I see with “cat –vt”?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">When I ran “file” on this file it says it is “UTF-8 Unicode text” whereas usually files of this type (without the special characters) simply show they are “ASCII text”. Presumably
it is the special characters in this one that make it appear as UTF-8. Doing :set options to change encoding to utf8 does NOT show the characters either.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<p style="line-height:10.0pt"><span style="font-size:10.0pt;font-family:"Arial","sans-serif"">CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended
recipient, any disclosure, copying, distribution, or use of the contents of this information is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message
in error, and delete it. Thank you <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" target="_blank">http://mail.ale.org/mailman/listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" target="_blank">http://mail.ale.org/mailman/listinfo</a><o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"> Ed Cashin <<a href="mailto:ecashin@noserose.net" target="_blank">ecashin@noserose.net</a>><o:p></o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>