egghelp/eggheads community

Getting values from a url (and count lines) - XML!

2008-12-17T12:39:29-04:00

damn, I just tested it on 4 channels (defined 10) and all works,
hmm

watch out for BIG and small letters :>

Statistics: Posted by tomekk — Wed Dec 17, 2008 12:39 pm

Getting values from a url (and count lines) - XML!

2008-12-17T12:23:53-04:00

Thanks - it's working perfectly... almost. If I'm setting three chans for "set *_chans {#chan1 #chan2}", the script won't work for the first two chans.

Statistics: Posted by JKM — Wed Dec 17, 2008 12:23 pm

Getting values from a url (and count lines) - XML!

2008-12-16T18:43:16-04:00

yap, if date will be exactly "N/A"

u can always use string match *smth* or regexp etc

Statistics: Posted by tomekk — Tue Dec 16, 2008 6:43 pm

Getting values from a url (and count lines) - XML!

2008-12-16T16:32:09-04:00

Would this be correct?

Code:

proc check_proc { nick uhost hand chan arg } {   global check_url check_url_arg check_chans   if {[lsearch $check_chans $chan] != -1} {      set check_arg [lindex [split $arg] 0]      if {$check_arg != ""} {         set xml_data [grab_http_data 2 $check_url $check_url_arg $check_arg]         if {$xml_data != "error"} {            regsub -all "\t" $xml_data "" xml_data            regsub -all "\n" $xml_data "" xml_data            regsub -all "\r" $xml_data "" xml_data            regsub "" $xml_data "\n" xml_data            regsub "<\/field>" $xml_data "\n<\/field>" xml_data            set xml_data_field [lindex [split $xml_data "\n"] 1]            set xml_data_tags {color date nick homepage posts birthday mail userid}            foreach xml_tag $xml_data_tags {               regsub -nocase "<$xml_tag>| <$xml_tag>" [string trim $xml_data_field] "" xml_data_field               regsub -nocase "<\/$xml_tag>" [string trim $xml_data_field] "\n" xml_data_field            }            set xml_data_lines [split $xml_data_field "\n"]            set x_color [lindex $xml_data_lines 0]            set x_date [lindex $xml_data_lines 1]            set x_posts [lindex $xml_data_lines 4]            set x_birthday [lindex $xml_data_lines 5]            if { $x_date != "N/A" } {              putquick "PRIVMSG $chan :color: $x_color, date: $x_date, posts: $x_posts, birthday: $x_birthday"             } else {              putquick "PRIVMSG $chan :Nothing found!"            }         }      }   }}

Statistics: Posted by JKM — Tue Dec 16, 2008 4:32 pm

Getting values from a url (and count lines) - XML!

2008-12-16T10:16:59-04:00

Code:

# Author: tomekk# e-mail:  tomekk/@/oswiecim/./eu/./org# home page: http://tomekk.oswiecim.eu.org/## Version 0.2## This file is Copyrighted under the GNU Public License.# http://www.gnu.org/copyleft/gpl.html# lines chansset lines_chans {#chan1 #chan2}# check chansset check_chans {#chan1 #chan2}# search chansset search_chans {#chan1 #chan2}# url to list file, row by rowset list_url "http://localhost/list.txt"# url to check script, one rowset check_url "http://localhost/check.php"# url to search script, row by rowset search_url "http://localhost/search.php"# check_url script argument, # will be: $check_url?$check_url_arg=$query, http://localhost/check.php?value=$queryset check_url_arg "value"# search_url script argument,# will be: $search_url?$search_url_arg=$query, http://localhost/search.php?value=$queryset search_url_arg "value"#######################################################################bind pub - !lines lines_procbind pub - !check check_procbind pub - !search search_procpackage require httpproc lines_proc { nick uhost hand chan arg } {global list_url lines_chansif {[lsearch $lines_chans $chan] != -1} {set data_lines [grab_http_data 1 $list_url "" ""]if {$data_lines != "error"} {set lines_counter 0# we can count list with [llength] but we dont want to count empty lines { }foreach data_line [split $data_lines "\n"] {if {$data_line != ""} {incr lines_counter 1}}putquick "PRIVMSG $chan :[expr $lines_counter - 1]"}}}proc check_proc { nick uhost hand chan arg } {global check_url check_url_arg check_chansif {[lsearch $check_chans $chan] != -1} {set check_arg [lindex [split $arg] 0]if {$check_arg != ""} {set xml_data [grab_http_data 2 $check_url $check_url_arg $check_arg]if {$xml_data != "error"} {regsub -all "\t" $xml_data "" xml_dataregsub -all "\n" $xml_data "" xml_dataregsub -all "\r" $xml_data "" xml_dataregsub "" $xml_data "\n" xml_dataregsub "<\/field>" $xml_data "\n<\/field>" xml_dataset xml_data_field [lindex [split $xml_data "\n"] 1]set xml_data_tags {color date nick homepage posts birthday mail userid}foreach xml_tag $xml_data_tags {regsub -nocase "<$xml_tag>| <$xml_tag>" [string trim $xml_data_field] "" xml_data_fieldregsub -nocase "<\/$xml_tag>" [string trim $xml_data_field] "\n" xml_data_field}set xml_data_lines [split $xml_data_field "\n"]set x_color [lindex $xml_data_lines 0]set x_date [lindex $xml_data_lines 1]set x_posts [lindex $xml_data_lines 4]set x_birthday [lindex $xml_data_lines 5]putquick "PRIVMSG $chan :color: $x_color, date: $x_date, posts: $x_posts, birthday: $x_birthday"}}}}proc search_proc { nick uhost hand chan arg } {global search_url search_url_arg search_chansif {[lsearch $search_chans $chan] != -1} {set search_arg [lindex [split $arg] 0]if {$search_arg != ""} {set data_lines [grab_http_data 2 $search_url $search_url_arg $search_arg]if {$data_lines != "error"} {set lines_counter 0set data_lines [split $data_lines "\n"]foreach data_line $data_lines {if {$data_line != ""} {incr lines_counter 1}}if {$lines_counter > 3} {set three_lines [lrange $data_lines 0 2]foreach one_line $three_lines {putquick "PRIVMSG $chan :$one_line"}set the_rest [expr $lines_counter - 3]putquick "PRIVMSG $chan :... And further $the_rest lines - $search_url?$search_url_arg=$search_arg"} else {foreach one_line $data_lines {putquick "PRIVMSG $chan :$one_line"}}}}}}proc grab_http_data { type url query arg } {set user_agent "http-query.tcl "set tiny_token [http::config -useragent $user_agent]if {$type == 1} {set tiny_token [http::geturl $url -timeout 10000]} else {# for longer queries should be ::http::formatQueryset proper_url "$url?$query=$arg"set tiny_token [http::geturl $proper_url -timeout 10000]}set html_data [http::data $tiny_token]if {$html_data != ""} {return $html_data} {return "error"}}putlog "http-query.tcl ver 0.1 by tomekk loaded"

tested with your xml, output:

15:15:31 <@tomekk> !check blah
15:15:31 < botty> color: blue, date: 19.12.08, posts: 46, birthday: N/A

try :>

Statistics: Posted by tomekk — Tue Dec 16, 2008 10:16 am

Getting values from a url (and count lines) - XML!

2008-12-16T08:35:51-04:00

It's like this:

Code:

blue19.12.08tomekkegghelp.org46N/Aegg@tomekk1

And I just want to get the values from:

Edit: I'm sorry, it's the !check script. And btw, I want the same with N/A. if one (ore more) of the mentioned xml tags contains "N/A" I would like to respond "N/A". :-p

Statistics: Posted by JKM — Tue Dec 16, 2008 8:35 am

Getting values from a url (and count lines) - XML!

2008-12-16T08:10:45-04:00

Hi there! The scripts is working great, but I was wondering if you could extend the !search script. I wan't to get xml data ( and but not the rest - including such as "" and so on.).

Thanks for the help this far!

hey,

Paste here full example of this XML structure, I need to see it
Insert some fake data etc.

Statistics: Posted by tomekk — Tue Dec 16, 2008 8:10 am

Getting values from a url (and count lines) - XML!

2008-12-15T18:16:26-04:00

Hi there! The scripts is working great, but I was wondering if you could extend the !search script. I wan't to get xml data ( and but not the rest - including such as "" and so on.).

Thanks for the help this far!

Statistics: Posted by JKM — Mon Dec 15, 2008 6:16 pm

Getting values from a url (and count lines) - XML!

2008-12-10T14:35:34-04:00

spanks!

Statistics: Posted by JKM — Wed Dec 10, 2008 2:35 pm

Getting values from a url (and count lines) - XML!

2008-12-10T13:43:19-04:00

Code:

proc check_proc { nick uhost hand chan arg } {        global check_url check_url_arg check_chans        if {[lsearch $check_chans $chan] != -1} {                set check_arg [lindex [split $arg] 0]                if {$check_arg != ""} {                        set one_data_line [grab_http_data 2 $check_url $check_url_arg $check_arg]                        if {$one_data_line != "error"} {                                if {$one_data_line != "  N/A  N/A  N/A  N/A  N/A  N/A  N/A  1  "} {                                        putquick "PRIVMSG $chan :$one_data_line"                                } else {                                        putquick "PRIVMSG $chan :Nothing found"                                }                        }                }        }}

"error" should stay because this inform script when page get timeout or some connection problem

" N/A N/A N/A N/A N/A N/A N/A 1 " - when line will be exactly like this one, without "enters" etc then should work

When line includes some html chars this should work too. (i mean whole line will be visible, with

etc tags.)

Statistics: Posted by tomekk — Wed Dec 10, 2008 1:43 pm

Getting values from a url (and count lines) - XML!

2008-12-10T12:55:50-04:00

Code:

proc check_proc { nick uhost hand chan arg } {global check_url check_url_arg check_chansif {[lsearch $check_chans $chan] != -1} {set check_arg [lindex [split $arg] 0]if {$check_arg != ""} {set one_data_line [grab_http_data 2 $check_url $check_url_arg $check_arg]if {$one_data_line != "error"} {putquick "PRIVMSG $chan :$one_data_line"}}}}

Again, thanks a lot! But I've got some questions.
1: I wan't to reply "Nothing found" if the line is " N/A N/A N/A N/A N/A N/A N/A 1 " - so would this work?

Code:

proc check_proc { nick uhost hand chan arg } {global check_url check_url_arg check_chansif {[lsearch $check_chans $chan] != -1} {set check_arg [lindex [split $arg] 0]if {$check_arg != ""} {set one_data_line [grab_http_data 2 $check_url $check_url_arg $check_arg]if {$one_data_line != "  N/A  N/A  N/A  N/A  N/A  N/A  N/A  1  "} {putquick "PRIVMSG $chan :$one_data_line"else {putquick "PRIVMSG $chan :Nothing found"}}}}}

2. If the code got DOCTYPE, and if the lines at the html page is listed with

, will the html code also be visible?

Statistics: Posted by JKM — Wed Dec 10, 2008 12:55 pm

Getting values from a url (and count lines) - XML!

2008-12-10T07:40:12-04:00

This script should only print the first three lines at the page (if there is more than three lines). At the end it should echo "... And further XX (Total lines - 3) lines - http://url".

Code:

# Author: tomekk# e-mail:  tomekk/@/oswiecim/./eu/./org# home page: http://tomekk.oswiecim.eu.org/## Version 0.1## This file is Copyrighted under the GNU Public License.# http://www.gnu.org/copyleft/gpl.html# lines chansset lines_chans {#chan1 #chan2}# check chansset check_chans {#chan1 #chan2}# search chansset search_chans {#chan1 #chan2}# url to list file, row by rowset list_url "http://localhost/list.txt"# url to check script, one rowset check_url "http://localhost/check.php"# url to search script, row by rowset search_url "http://localhost/search.php"# check_url script argument, # will be: $check_url?$check_url_arg=$query, http://localhost/check.php?value=$queryset check_url_arg "value"# search_url script argument,# will be: $search_url?$search_url_arg=$query, http://localhost/search.php?value=$queryset search_url_arg "value"#######################################################################bind pub - !lines lines_procbind pub - !check check_procbind pub - !search search_procpackage require httpproc lines_proc { nick uhost hand chan arg } {global list_url lines_chansif {[lsearch $lines_chans $chan] != -1} {set data_lines [grab_http_data 1 $list_url "" ""]if {$data_lines != "error"} {set lines_counter 0# we can count list with [llength] but we dont want to count empty lines { }foreach data_line [split $data_lines "\n"] {if {$data_line != ""} {incr lines_counter 1}}putquick "PRIVMSG $chan :[expr $lines_counter - 1]"}}}proc check_proc { nick uhost hand chan arg } {global check_url check_url_arg check_chansif {[lsearch $check_chans $chan] != -1} {set check_arg [lindex [split $arg] 0]if {$check_arg != ""} {set one_data_line [grab_http_data 2 $check_url $check_url_arg $check_arg]if {$one_data_line != "error"} {putquick "PRIVMSG $chan :$one_data_line"}}}}proc search_proc { nick uhost hand chan arg } {global search_url search_url_arg search_chansif {[lsearch $search_chans $chan] != -1} {set search_arg [lindex [split $arg] 0]if {$search_arg != ""} {set data_lines [grab_http_data 2 $search_url $search_url_arg $search_arg]if {$data_lines != "error"} {set lines_counter 0set data_lines [split $data_lines "\n"]foreach data_line $data_lines {if {$data_line != ""} {incr lines_counter 1}}if {$lines_counter > 3} {set three_lines [lrange $data_lines 0 2]foreach one_line $three_lines {putquick "PRIVMSG $chan :$one_line"}set the_rest [expr $lines_counter - 3]putquick "PRIVMSG $chan :... And further $the_rest lines - $search_url?$search_url_arg=$search_arg"} else {foreach one_line $data_lines {putquick "PRIVMSG $chan :$one_line"}}}}}}proc grab_http_data { type url query arg } {set user_agent "http-query.tcl "set tiny_token [http::config -useragent $user_agent]if {$type == 1} {set tiny_token [http::geturl $url -timeout 10000]} else {# for longer queries should be ::http::formatQueryset proper_url "$url?$query=$arg"set tiny_token [http::geturl $proper_url -timeout 10000]}set html_data [http::data $tiny_token]if {$html_data != ""} {return $html_data} {return "error"}}putlog "http-query.tcl ver 0.1 by tomekk loaded"

try :>

Statistics: Posted by tomekk — Wed Dec 10, 2008 7:40 am

Getting values from a url (and count lines) - XML!

2008-12-09T19:30:26-04:00

This script should only print the first three lines at the page (if there is more than three lines). At the end it should echo "... And further XX (Total lines - 3) lines - http://url".

Statistics: Posted by JKM — Tue Dec 09, 2008 7:30 pm

Getting values from a url (and count lines) - XML!

2008-12-09T16:10:06-04:00

Thanks a lot! I can't - unfortunately - test it before friday (when I'm ordering my shell).

By the way, could you please make another thing for me?
!search xx -> paste the result from mypage.com?search.php?f=xx. IF the page shows more than three rows (ex. 20 lines), it should past it like this:

row1
row2
row3
... And further 17 (20-3) lines: mypage.com?search.php?f=xx

after 3 lines script should write link to this or this script should print all 20 lines?

Statistics: Posted by tomekk — Tue Dec 09, 2008 4:10 pm

Getting values from a url (and count lines) - XML!

2008-12-09T15:26:29-04:00

Thanks a lot! I can't - unfortunately - test it before friday (when I'm ordering my shell).

By the way, could you please make another thing for me?
!search xx -> paste the result from mypage.com?search.php?f=xx. IF the page shows more than three rows (ex. 20 lines), it should past it like this:

row1
row2
row3
... And further 17 (20-3) lines: mypage.com?search.php?f=xx

Statistics: Posted by JKM — Tue Dec 09, 2008 3:26 pm