Forums Scripts & Popups Getting infomation from a webpage with sockets

Print Thread

Getting infomation from a webpage with sockets #145307 21/03/06 07:45 PM
Joined: Jun 2004 Posts: 33 X Xidus OP Ameglian cow
OP Xidus Ameglian cow X Joined: Jun 2004 Posts: 33	Hey, ive had some experience with mIRC scripting but none with sockets, i run a server and i need to make a script for my bot that, with a remote, will put the html code into a variable and then parse it searching for multiple lines of text. Any help will be much appreciated. Thanks Xidus

Re: Getting infomation from a webpage with sockets

#145308 21/03/06 10:09 PM

Joined: Jun 2004

Posts: 33

Xidus

Ameglian cow

Xidus

Ameglian cow

Joined: Jun 2004

Posts: 33

Sorry about double post but edit time expired, this is my code so far

Code:

/xile { /sockopen Xile http://xilero.net 80
  on *:sockopen:Xile:{
    sockwrite -n $socketname GET /forumlist.php HTTP/1.1 
    sockwrite -n $socketname Host: xilero.net $+ $crlf $+ $crlf
  }
}
ON *:sockread:Xile:{
  if ($sockerr) {
    echo -a Error.
    halt
  }
  else {
    var %temptext
    sockread %temptext
    if (&lt;table&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Login:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Login: Online
    }
    if (&lt;table&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Login:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Offline&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Login: Offline
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Char:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Char: Online
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Char:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Offline&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Char: Offline
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Map:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Map: Online
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Map:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Offline&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Map: Offline
    }
  }
}

When i do the command /xile i get the errors

Code:

 * /sockwrite: 'GET' no such socket (line 3, aliases1.ini)
-
*:SOCKREAD:XILE:{ Unknown command
-

Re: Getting infomation from a webpage with sockets #145309 21/03/06 10:52 PM
Joined: Nov 2005 Posts: 104 Dover, Delaware D drc4 Vogon poet
drc4 Vogon poet D Joined: Nov 2005 Posts: 104 Dover, Delaware	shouldn't the $socketname be $sockname ? That would explain why it's trying to use GET as the socket instead of the actual socket. I've never really used sockets other than for version checking, but it does make sense to me.

Re: Getting infomation from a webpage with sockets #145310 21/03/06 10:54 PM
Joined: Jun 2004 Posts: 33 X Xidus OP Ameglian cow
OP Xidus Ameglian cow X Joined: Jun 2004 Posts: 33	hits head whoops, i still get Code: * /sockwrite: 'GET' no such socket (line 3, aliases1.ini) - *:SOCKREAD:XILE:{ Unknown command - Though :P Thanks

Re: Getting infomation from a webpage with sockets #145311 21/03/06 11:06 PM
Joined: Nov 2005 Posts: 104 Dover, Delaware D drc4 Vogon poet
drc4 Vogon poet D Joined: Nov 2005 Posts: 104 Dover, Delaware	lol, I know this isn't prob. the best method.. but $sock(xile).name should work.

Re: Getting infomation from a webpage with sockets #145312 21/03/06 11:07 PM
Joined: Jun 2004 Posts: 33 X Xidus OP Ameglian cow
OP Xidus Ameglian cow X Joined: Jun 2004 Posts: 33	OK, getting somewhere XD now i get: Code: * /sockwrite: 'Xile' not connected (line 3, aliases1.ini) - *:SOCKREAD:XILE:{ Unknown command -

Re: Getting infomation from a webpage with sockets #145313 21/03/06 11:10 PM
Joined: Nov 2005 Posts: 104 Dover, Delaware D drc4 Vogon poet
drc4 Vogon poet D Joined: Nov 2005 Posts: 104 Dover, Delaware	yeah. But I'm sure someone that's familiar with sockets will be on soon, and can offer better help. I was just playing around out of boredom. :-\, but the $sock(xile).name kept from showing me any error messages on the sockwrite.

Re: Getting infomation from a webpage with sockets #145314 21/03/06 11:15 PM
Joined: Nov 2005 Posts: 104 Dover, Delaware D drc4 Vogon poet
drc4 Vogon poet D Joined: Nov 2005 Posts: 104 Dover, Delaware	I also noticed that you're missing a closing bracket. Code: /xile { /sockopen Xile http://xilero.net 80 on :sockopen:Xile:{ should be Code: /xile { /sockopen Xile http://xilero.net 80 } on :sockopen:Xile:{ ' Empashis on the closing bracket on the first line.

Re: Getting infomation from a webpage with sockets #145315 21/03/06 11:15 PM
Joined: Jun 2004 Posts: 33 X Xidus OP Ameglian cow
OP Xidus Ameglian cow X Joined: Jun 2004 Posts: 33	when i do that nothing happens at all Last edited by Xidus; 21/03/06 11:16 PM.

Re: Getting infomation from a webpage with sockets #145316 21/03/06 11:43 PM
Joined: Dec 2002 Posts: 580 N NaquadaServ Fjord artisan
NaquadaServ Fjord artisan N Joined: Dec 2002 Posts: 580	drc4, almost had their finger on the problem... You can not nest events inside an alias, '/' prefixes can only be used in the aliases section to my knowledge, ALL events must be in remotes... Code: alias xile { sockopen Xile http://xilero.net 80 } on *:sockopen:Xile:{ sockwrite -n $socketname GET /forumlist.php HTTP/1.1 sockwrite -n $socketname Host: xilero.net $+ $crlf $+ $crlf } Learning mIRC's syntax first might help you... /help Remote Scripts /help Aliases

Re: Getting infomation from a webpage with sockets #145317 22/03/06 12:11 AM
Joined: Jun 2004 Posts: 33 X Xidus OP Ameglian cow
OP Xidus Ameglian cow X Joined: Jun 2004 Posts: 33	Ahhh, i see Now how some reason it thinks that the socket hasn't connected Code: * /sockwrite: 'Xile' not connected (line 5, script1.ini)

Re: Getting infomation from a webpage with sockets #145318 22/03/06 12:51 AM
Joined: Dec 2002 Posts: 580 N NaquadaServ Fjord artisan
NaquadaServ Fjord artisan N Joined: Dec 2002 Posts: 580	Odd, SockOpen event shouldn't occur unless the socket was opened... Use the command "/socklist" to view open sockets... Try $sockname instead of $socketname... Also check $sockerr is zero as the first line in *:sockread... Code: if ($sockerr) { echo -s SockError $sockname $sockerr return }

Re: Getting infomation from a webpage with sockets

#145319 22/03/06 12:53 AM

Joined: Jun 2004

Posts: 33

Xidus

Ameglian cow

Xidus

Ameglian cow

Joined: Jun 2004

Posts: 33

Ok, when i do /socklist it says there are no sockets open :P The current code is:

Code:

alias xile {
  sockopen Xile http://xilero.net 80
}
on *:sockopen:Xile:{
  sockwrite -n $sock(Xile).name GET /home.php HTTP/1.1
  sockwrite -n $sock(Xile).name Host: xilero.net $+ $crlf $+ $crlf 
}
ON *:sockread:Xile:{
  if ($sockerr) {
    echo -s SockError $sockname $sockerr
    return
  }
  else {
    var %temptext
    sockread %temptext
    if (&lt;table&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Login:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Login: Online
    }
    if (&lt;table&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Login:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Offline&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Login: Offline
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Char:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Char: Online
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Char:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Offline&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Char: Offline
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Map:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Map: Online
    }
    if (&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Map:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: red ; font-weight: 700" &gt;&lt;b&gt;Offline&lt;/b&gt;&lt;/span&gt;) {
      echo XileRO Map: Offline
    }
  }

*Xidus cry's in a corner

Re: Getting infomation from a webpage with sockets #145320 22/03/06 01:18 AM
Joined: Dec 2002 Posts: 1,245 California, doooood M MikeChat Hoopy frood
MikeChat Hoopy frood M Joined: Dec 2002 Posts: 1,245 California, doooood	Quote: alias xile { sockopen Xile http://xilero.net 80 } * Dns resolving http://xilero.net * Dns unable to resolve http://xilero.net - * Dns resolving xilero.net xilero.net resolved to 72.29.77.223 ok, so we see http isnt working, and the TLD is, so .... alias xile { sockopen Xile xilero.net 80 } on :sockopen:Xile:{ sockwrite -n Xile GET (What? Where?) /home.php HTTP/1.1 put the full path there and see what happens sockwrite -n Xile Host: xilero.net $+ $crlf $+ $crlf }

Re: Getting infomation from a webpage with sockets #145321 22/03/06 01:19 AM
Joined: Nov 2005 Posts: 104 Dover, Delaware D drc4 Vogon poet
drc4 Vogon poet D Joined: Nov 2005 Posts: 104 Dover, Delaware	don't know if there's a reason for it. But when I tried just /sockopen http://www.google.com it would'nt open the socket. but /sockopen google.com opened the socket. So try leaving out the http:// part of the sockopen in the alias.

Re: Getting infomation from a webpage with sockets #145322 22/03/06 01:25 AM
Joined: Dec 2002 Posts: 1,245 California, doooood M MikeChat Hoopy frood
MikeChat Hoopy frood M Joined: Dec 2002 Posts: 1,245 California, doooood	I think sockopen www.google.com 80 might be better with the commercial site, especially if they have different IP addresses for web access than other com access they might have. FEX * Dns resolving google.com google.com resolved to 72.14.207.99 - * Dns resolving www.google.com www.google.com resolved to 66.102.7.99 though I am not sure in this case if you would or would not be able to access the google info you wanted.

Re: Getting infomation from a webpage with sockets

#145323 22/03/06 02:37 AM

Joined: Oct 2005

Posts: 1,671

genius_at_work Offline

Hoopy frood

genius_at_work

Hoopy frood

Joined: Oct 2005

Posts: 1,671

I got the socket to read using this code:

Code:

alias xile {
  if ($sock(xile)) sockclose xile
  sockopen xile xilero.net 80
}
on *:sockopen:xile:{
  sockwrite -n $sockname GET /home.php HTTP/1.1
  sockwrite -n $sockname Host: xilero.net $+ $crlf $+ $crlf 
}
ON *:sockread:xile:{
  if ($sockerr) {
    echo -s SockError $sockname $sockerr
    return
  }

  var %t
  sockread %t
  echo -s &gt; %t

  if (*XiLeRO Login:*Online* iswm %t) {
    echo 3 -s XileRO Login: Online
  }
  elseif (*XiLeRO Login:*Offline* iswm %t) {
    echo 4 -s XileRO Login: Offline
  }
  elseif (*XiLeRO Char:*Online* iswm %t) {
    echo 3 -s XileRO Char: Online
  }
  elseif (*XiLeRO Char:*Offline* iswm %t) {
    echo 4 -s XileRO Char: Offline
  }
  elseif (*XiLeRO Map:*Online* iswm %t) {
    echo 3 -s XileRO Map: Online
  }
  elseif (*XiLeRO Map:*Offline* iswm %t) {
    echo 4 -s XileRO Map: Offline
  }
}

It catches two of the online/offline lines, but for some reason, the socket is getting strange data in the middle of one line which is disrupting the third catch.

When I open the webpage in a browser and view the source, I get this bit of code:

Code:

&lt;table&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Login:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: green ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;
&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Char:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: green ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;
&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Map:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: green ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;

But when I view the exact same page with the mIRC socket, I get this code:

Code:

&lt;table&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Login:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: green ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;
&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;span style="color: black" &gt;XiLeRO Char:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;s
54
pan style="color: green ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;
&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;
5e3
&lt;span style="color: black" &gt;XiLeRO Map:&lt;/span&gt;&lt;/td&gt;&lt;td&gt;&lt;span style="color: green ; font-weight: 700" &gt;&lt;b&gt;Online&lt;/b&gt;&lt;/span&gt;

I have absolutely no idea where the "54" and "5e3" and extra carriage returns are coming from. If anyone knows, please share with the rest of the class. ;P

-genius_at_work

Re: Getting infomation from a webpage with sockets #145324 22/03/06 10:42 AM
Joined: Feb 2004 Posts: 2,013 Leuven, Belgium F FiberOPtics Hoopy frood
FiberOPtics Hoopy frood F Joined: Feb 2004 Posts: 2,013 Leuven, Belgium	If you change the request to HTTP/1.0 then that weird data should be gone. The reason is that with the 1.1 request for this site, you'll get the header Transfer-Encoding: chunked, which means your data will be retrieved in chunks. At the end of the chunks (when all data has been retrieved), you'll see a 0 followed by some optional ending headers (footers) and a blank line. Those weird chars denote the size of the chunk that is being sent in hex. For example the first value I got was "d7e", which converted to the decimal system means $base(d7e,16,10) = 3454, in other words the number of bytes of the chunk. Each chunk will have that hex char possibly followed by a semicolon and extra parameters you can ignore. The line with the hex char will have a crlf following it, so will the data. Note that putting 1.1 doesn't automatically mean your data will always be received in chunks, it depends on the server, but since 1.0 doesn't support this method afaik, you won't get chunked responses, thus neither those hex chars.

Re: Getting infomation from a webpage with sockets #145325 22/03/06 03:05 PM
Joined: Oct 2005 Posts: 1,671 G genius_at_work Hoopy frood
genius_at_work Hoopy frood G Joined: Oct 2005 Posts: 1,671	That's good to know. I'm not too familiar with transfer protocols, so I never would have guessed that was the problem. -genius_at_work

Link Copied to Clipboard