egghelp/eggheads community

Problem with some characters

2004-12-21T11:34:12-04:00

I just played today a bit with Japanese input, and tried if I can write something Japanese in mIRC... (after I managed to find a suitable font I manged to get it working ^^).

[15:55] $B$h(B

[15:55:37] <@StarZ|De_Kus> よ

Your host is irc.hes.de.euirc.net, running version euIRCd1.1.5

This looks kinda strange to me... (remember, local log is not precessed by the ircd). Local it is right, 1 Japanse character to 2 unicode characters, but the bot seems to get something more, but I dont know its mircs send mode fault ^^. If you want I can try on QuakeNet, too ^^.

PS: I asked one person in the channel how many chars he sees when I write 1 Japanse char and he saw 8(omfg!). Seems to be the fault of the ircd?!

[16:48:17] よ　なに　明日美
[16:48:23] <+Klinke> ????
...
[17:02:52] nur interessehalber... wieviele zeichen hab ihr da oben eigentlich gesehen?
[17:02:58] <+Klinke> よ　なに　明日美

after asking him how many chars he had seen he copied from my line and I could read it again.

[17:08] [StarZ|De_Kus!DeKus@De_Kus.users.quakenet.org] $B$h!!$J$K!!L@F|H~(B

this is the same line again in the eggdrop log... looks wired again.

PPS: to thoese who can "read" what there is written in Japanase... it was not supposed to make any sense, please don't ask about it . Probably I should have pressed space in the first 2 words, too. I dont know if they would be used in Hiragana.. you see... I am just playing around .

Statistics: Posted by De Kus — Tue Dec 21, 2004 11:34 am

Problem with some characters

2004-12-20T10:05:10-04:00

If you need any information from me or do you want me to run some script for testing please let me know

I am really appreciated your help

Statistics: Posted by tnd — Mon Dec 20, 2004 10:05 am

Problem with some characters

2004-12-20T00:33:52-04:00

But I do know eggdrops have problems with special character's. Well generally all ASCII [0-255] work. However with tcl scripts I've noticed you have to use their hex formats in html \x80, \xA2, \xFF and not themselves plainly.

this is irrelevant to that guy's problem, he doesn't use Tcl scripts and talks about channel messages, not channel names (did you read my last post at all?)

As for non ASCII characters such as arabic, turkish, thai, chinese, japanese and etc the eggdrop could definately have problems, even the ircd.

Tcl (8.0 and higher) internally uses Unicode for character representation, so there's no info loss in that regard, only sloppy script writers

Statistics: Posted by demond — Mon Dec 20, 2004 12:33 am

Problem with some characters

2004-12-19T21:38:23-04:00

But I do know eggdrops have problems with special character's. Well generally all ASCII [0-255] work. However with tcl scripts I've noticed you have to use their hex formats in html \x80, \xA2, \xFF and not themselves plainly.

As for non ASCII characters such as arabic, turkish, thai, chinese, japanese and etc the eggdrop could definately have problems, even the ircd.

Statistics: Posted by awyeah — Sun Dec 19, 2004 9:38 pm

Problem with some characters

2004-12-19T21:22:48-04:00

Taken from: eggdrop1.6.xx/doc/known-problems.txt
Things that are broken, but aren't getting fixed anytime soon:

* High-bit characters are being filtered from channel names. This is a
fault of the Tcl interpreter, and not Eggdrop. The Tcl interpreter
filters the characters when it reads a file for interpreting. Update
your Tcl to version 8.1 or higher.

* Version 8.1 of Tcl doesn't support unicode characters, for example, è.
If those characters are handled in a script as text, you run into errors.
Eggdrop can't handle these errors at the moment.

this should not have anything to do with Tcl - if that guy really doesn't use scripts for processing channel chatter, as he says; note that the docs say "from channel names", not channel chatter, channel messages or anything like that - for a good reason - the reason being that eggdrop doesn't process channel chatter at all, whereas it processes channel names (i.e. channel names are being submitted to scripts, at least to the config file, which is, after all, a Tcl script)

Statistics: Posted by demond — Sun Dec 19, 2004 9:22 pm

Problem with some characters

2004-12-19T21:13:42-04:00

Taken from: eggdrop1.6.xx/doc/known-problems.txt

Things that are broken, but aren't getting fixed anytime soon:

* High-bit characters are being filtered from channel names. This is a
fault of the Tcl interpreter, and not Eggdrop. The Tcl interpreter
filters the characters when it reads a file for interpreting. Update
your Tcl to version 8.1 or higher.

* Version 8.1 of Tcl doesn't support unicode characters, for example, è.
If those characters are handled in a script as text, you run into errors.
Eggdrop can't handle these errors at the moment.

Statistics: Posted by awyeah — Sun Dec 19, 2004 9:13 pm

Problem with some characters

2004-12-18T06:09:51-04:00

I try to remove all scripts and load the follow modules

Module loaded: dns
Module loaded: channels
Module loaded: irc
Module loaded: server
Module loaded: ctcp
Module loaded: notes (with lang support)
Module loaded: console (with lang support)
Module loaded: blowfish
Module loaded: assoc

The problem still exists

Statistics: Posted by tnd — Sat Dec 18, 2004 6:09 am

Problem with some characters

2004-12-18T05:10:28-04:00

assuming that you don't use a script for that, it sounds puzzling to me... but I'll take a look at the source, although I'm pretty sure eggdrop doesn't convert PRIVMSGs

Statistics: Posted by demond — Sat Dec 18, 2004 5:10 am

Problem with some characters

2004-12-18T04:05:47-04:00

Yes I set +p and turn on everything msgs, public, joins, kicks/modes, cmds, misc, bots, files, server, debug, wallops

Public message (also server message, NickServ reply) was altered but message when user talking in party-line not altered.

Statistics: Posted by tnd — Sat Dec 18, 2004 4:05 am

Problem with some characters

2004-12-18T03:49:54-04:00

you mean you have console +p? or do you use some script that relays channel messages to party-line (effectively the same as console +p)?

Statistics: Posted by demond — Sat Dec 18, 2004 3:49 am

Problem with some characters

2004-12-18T03:32:45-04:00

I found the channel message in party line that some charactors was altered.

But the messages that type in party line show correctly.

Statistics: Posted by tnd — Sat Dec 18, 2004 3:32 am

Problem with some characters

2004-12-18T03:18:47-04:00

oops you've already given version details...

I actually wonder if this is a script output or not; and if not, where exactly did you notice it

Statistics: Posted by demond — Sat Dec 18, 2004 3:18 am

Problem with some characters

2004-12-18T03:15:09-04:00

why don't you simply describe your situation in details? i.e. how and where exactly have you observed that issue - in the bot's log, on party-line, in some script's output, or whatever; also provide details about your configuration - eggdrop version, Tcl version, loaded scripts etc.

Statistics: Posted by demond — Sat Dec 18, 2004 3:15 am

Problem with some characters

2004-12-17T23:19:49-04:00

I don't actaully mean by that but you said "eggdrop doesn't alter server's output" so i think it may be tcl encoding setting and I don't think that tcl script will change this.

At first point I think that it need some patch for server module.

Statistics: Posted by tnd — Fri Dec 17, 2004 11:19 pm

Problem with some characters

2004-12-17T23:15:30-04:00

what tcl?

you didn't say anything about a tcl script

did you mean that characters become garbled after processing by a script?

Statistics: Posted by demond — Fri Dec 17, 2004 11:15 pm