|
|
Joined: Dec 2004
Posts: 81
Babel fish
|
OP
Babel fish
Joined: Dec 2004
Posts: 81 |
I'm working on a script which downloads the search results web page from a webserver. I know how I can do this but was just curious if there's a better way. I'm trying to workaround the /set: line too long error in mIRC when sockreading. So I've decided to write the file to disk and then parse the file though I'm still getting errors. The problem is all of the TAB chrs at the beginning of lines in the file. Any ideas?
|
|
|
|
|
Joined: Sep 2004
Posts: 237
Fjord artisan
|
|
Fjord artisan
Joined: Sep 2004
Posts: 237 |
Nice Code! Come up with that all on your own?  Perhaps its not too late to edit that and add the code.
|
|
|
|
|
Joined: Dec 2004
Posts: 81
Babel fish
|
|
OP
Babel fish
Joined: Dec 2004
Posts: 81 |
Actually figured it out 
alias test2 {
var %idx = 0, %b, %chr
write -c txt.txt
fopen a page.txt
while (!feof) {
if ($ferr || $feof) { fclose a | return }
%b = $fread(a,4096,&var)
if (%b) {
while (%idx < %b) {
inc %idx
%chr = $bvar(&var,%idx)
if ($istok(10.13,%chr,46)) { bset &new %idx %chr }
elseif (!$istok(10.13.9,%chr,46)) { bset &new %idx %chr }
}
bwrite txt.txt -1 &new
%idx = 0
bunset &new
}
}
}
It's still a little slow and freezes mIRC for about 15-30 seconds, not too bad, I suppose.
Last edited by nycdiesel; 10/02/05 09:40 PM.
|
|
|
|
|
Joined: Sep 2003
Posts: 4,230
Hoopy frood
|
|
Hoopy frood
Joined: Sep 2003
Posts: 4,230 |
Im supprised this was all that was needed to reduce lines to managable sizes, but if it is it is. Use this its alot faster. alias test2 {
var %idx = 0, %b, %chr
write -c txt.txt
.fopen a page.txt
while (!feof) {
if ($ferr || $feof) { .fclose a | return }
%b = $fread(a,4096,&var)
if (%b) {
if (1) {
while ($bfind(&var, $v1, 9)) {
bset &var $v1 0
}
bwrite txt.txt -1 &var
}
}
}
}
The if (1) { is needed to preload $v1 for the while loop
|
|
|
|
|
Joined: Dec 2004
Posts: 81
Babel fish
|
|
OP
Babel fish
Joined: Dec 2004
Posts: 81 |
Thanks Dave, much appreciated I wasn't too familiar with those v1, v2 things but I did my homework, heh. Anyways I'm still encountering a problem when attempting to parse the file after calling test2 .. *shrugs* my second test alias echoed the contents of the file and it to the end of the file but it was only showing partial lines.
|
|
|
|
|
Joined: Sep 2003
Posts: 4,230
Hoopy frood
|
|
Hoopy frood
Joined: Sep 2003
Posts: 4,230 |
try this, alias test1 {
var %idx = 0, %b, %chr
write -c txt.txt
.fopen a page.txt
while (!feof) {
if ($ferr || $feof) { .fclose a | return }
%b = $fread(a,4096,&var)
if (%b) {
if (1) {
while ($bfind(&var, $v1, 9)) {
bset &var $v1 10
}
}
if (1) {
while ($bfind(&var, $v1, 60)) {
bset &var $v1 10
}
}
bwrite txt.txt -1 &var
}
}
}
I dumped the 0 byte as i remebered it terminates the line, following data well not read from that line. I now change TAB to LF and < to LF, this should be enough to break the lines down to managable sizes. Just remeber that you cant search for <TR> sine it well just be TR> at the start of a line, and also that there well be $null length lines in the file.
|
|
|
|
|
Joined: Aug 2003
Posts: 1,831
Hoopy frood
|
|
Hoopy frood
Joined: Aug 2003
Posts: 1,831 |
This writes it back to the same file, if you really want the extra file just change the blue page.txtalias testb {
bread page.txt 1 $file(page.txt) &a
breplace &a 9 10 60 10
bwrite [color:blue]page.txt[/color] 1 -1 &a
}
|
|
|
|
|
Joined: Aug 2003
Posts: 1,831
Hoopy frood
|
|
Hoopy frood
Joined: Aug 2003
Posts: 1,831 |
That last post of mine should have been directed to you. I noticed this in your code Should be they way you have it there "!feof" is just a string (which would always be true), same as Daves "if (1)" - //linesep | if !feof { echo -a $v1 } | if feof { echo -a $v1 }
|
|
|
|
|
Joined: Sep 2003
Posts: 4,230
Hoopy frood
|
|
Hoopy frood
Joined: Sep 2003
Posts: 4,230 |
This writes it back to the same file, if you really want the extra file just change the blue page.txtalias testb {
bread page.txt 1 $file(page.txt) &a
breplace &a 9 10 60 10
bwrite [color:blue]page.txt[/color] 1 -1 &a
}Oh that is way nicer method, I was just adjusting his code, since i saw the byte by byte checking, and thought Im sure u can just find the values u want in the var instead, should have stepped back and looked at what he wanted as a result, rather than how to improve his code. Goes the same for the while (!feof) { I didnt even look at it 
|
|
|
|
|
