You are thinking along the same lines I am. The app can be modified but that would require negotiations/updates/money/work. I have a watchdog to do the deed already (mostly) written. done files is named filename.done so it matches up with the naming scheme of the source data file. While we have a support agreement, I've hit several situations where what I needed to do would alter the program and affect the support agreement. Thus I had to stop pursuing that line.<br>
<br>Given that we can can not change the app without support issues, changing the output seems to be a bad idea. I like splitting the metadata to a separate file anyway. It makes the check easier to do:<br><br>if [ $(wc -l filename) -eq $(tail -n 1 filename.done) ]; then ...<br>
<br>The done file is a requirement of the third party group as part of their practices. <br><br><div class="gmail_quote">On Wed, Mar 3, 2010 at 5:59 PM, scott <span dir="ltr"><<a href="mailto:scott@sboss.net">scott@sboss.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA512<br>
<br>
a few questions that will help you in the right direction (whatever it may be):<br>
<br>
*) the non-free app (w/ database), do you a support contract with the company?<br>
<br>
if so, have you asked them if that is an option for them to add the rowcount to the end of the output file?<br>
<br>
Have you asked them if you add the rowcount to the end of the file, will it break their application?<br>
<br>
*) instead of modifing the non-free app (w/ database) to create a done file for the third party app, can you write a watchdog script/daemon (in the language of your choice) to monitor the output file and when it is completely there, to create the done file. For instance to a md5sum (or some checksum hash of your choice) on the file, and the next time you check the file to see if the md5sum is the same. If so, touch the done file otherwise update the "internal registry" for the new md5sum of the file. repeat This is good way since you are not changing any commercial/non-free apps. It is some duct tape around the two apps so they work together better.<br>
<br>
*) you comment about putting the rowcount in the done file. That is not a bad idea. Another thing is you can put the md5sum of the file too. Well there is lots you can do but time/effort is your limiters.<br>
<br>
Did the third party app say why they want the rowcount in the output file over a secondary file?<br>
<br>
How about if ${filename} is the filename of the output file, why not ${filename}.done for the done file and ${filename}.md5sum for the md5sum? Yeah you are creating extra files but they are small and you can use scripts/programs to use them to verify the files for the commercial apps.<br>
<br>
<br>
Here is my personal opinion, and please take it with a large grain of salt (size of a salt lick would be good!). Dont change the input/output files of a commercial application. Now if you can request the vendor to make the mods for you, that is great. But you dont want to get in a situation where you are in a situation where the process is broken and the vendor blames you modifying the input/output files. Depending on the vendor and your relationship with them depends on how much further at that point they will help you. Most vendors have some sort of RFE (Request For Enhancement - they might call it something else) process. Generally if I have seen if more than one customer asks for something most of them will add it, even if it is an option.<br>
<br>
It also might be good to get someone(s) from each of the vendor companies in the same room (or virtual room) to discuss what you are trying to do and let the two vendors duke it out over put what in what file and so forth. Sometimes that is helpful to move the process along instead of you playing messenger between them.<br>
<br>
Good Luck!!<br>
<div><div></div><div class="h5"><br>
<br>
On Mar 3, 2010, at 5:31 PM, Jim Kinney wrote:<br>
<br>
> I am having a disagreement with a procedure and am seeking other views.<br>
><br>
> A non-free app generates a data file from a database function (database also part of the non-free app).<br>
><br>
> A third party application needs to scp that file elsewhere for further processing.<br>
><br>
> The third party wants a "done" file to indicate the app has finished writing to the file. That's not needed due to how the app does it's write then a move to the final location. No problem to touch a done file.<br>
><br>
> Third party also wants the total row count in the data file appended to the data file.<br>
><br>
> This is where I disagree. I would far rather put the additional data in the done file and not alter the output in anyway.<br>
><br>
> Granted, adding the row count is trivial (wc -l filename >> filename) and that last line will be nothing like the actual data lines. It does make reprocessing the data files more complicated as they have to be checked for the presence of the row count on the last line before rerunning the import process again.<br>
><br>
> Other views?<br>
><br>
> --<br>
> --<br>
> James P. Kinney III<br>
> Actively in pursuit of Life, Liberty and Happiness<br>
><br>
</div></div>> _______________________________________________<br>
> Ale mailing list<br>
> <a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
> <a href="http://mail.ale.org/mailman/listinfo/ale" target="_blank">http://mail.ale.org/mailman/listinfo/ale</a><br>
> See JOBS, ANNOUNCE and SCHOOLS lists at<br>
> <a href="http://mail.ale.org/mailman/listinfo" target="_blank">http://mail.ale.org/mailman/listinfo</a><br>
<br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG/MacGPG2 v2.0.12 (Darwin)<br>
<br>
iQIcBAEBCgAGBQJLjunXAAoJEF51inK7SsNsWnMQAJAJGoof/jSrQNPpMMLBKDwn<br>
d8jIs5qwI2bGxR739sJNhJtrjLynoeEWDVDiHVeHowsSvwKH5QDC9mT77fSutyKA<br>
nH08Z7Pk5/B7xsqlkx/rwYQkt1Nua97mHmh/qa32NSLxQN5U+hQshUv2gDXTQwiN<br>
w+hDcYbZVLINdkYbZ1BoR1g2q/bE+wcqHC3x45VM1iJgz9jlM/9JjbhJZASmxIHp<br>
56Aeets8fz19luPJAE7n7gX1/odVsGOpvC0wbcFchejAyKpTX1lj4ww4wVB9uQHh<br>
gXL3d2gZPEOnuqoSU82iO3KqzVaVVG/1yapcgubKgl2P2qZqu17VdgkyvgnsXWLZ<br>
yiRK/+m6WIvHAWRmSQbDGMNUIOrYPHDGPJhDmV4pMcHutH71E0jiyd4uDiCpvhLN<br>
o4znh5VujoywvnYz2bmw6XwnMDsxGGU6WN4Wwqxa1YsoeUaoYPpjWvUv5ykOlIy/<br>
kYbt1Zy8drp2lNwgaFSEjyiVOtZqKqNKh92yd43nnu6R/vTfSHxxdncEX8LhnqIi<br>
QlWF5G0IOJNgihNh4Ub4KJ2ElyURpIZczkOM9VFoLaRC4buTLqmJlKj1rTy2mXiI<br>
bz4uwnyUhXJoTHFm866e5UIBMs95hgu00j8S/coprW6fG4jRtlifx50bnBle2tMk<br>
Mjr1Sme+R1BDo5A/LM+b<br>
=uVvE<br>
-----END PGP SIGNATURE-----<br>
<br>
_______________________________________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" target="_blank">http://mail.ale.org/mailman/listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" target="_blank">http://mail.ale.org/mailman/listinfo</a><br>
</blockquote></div><br><br clear="all"><br>-- <br>-- <br>James P. Kinney III<br>Actively in pursuit of Life, Liberty and Happiness <br><br>