Edi Weitz | 21 May 2007 22:38
Picon
Favicon

Re: Flexi-streams test suite failing on OpenMCL

On Mon, 21 May 2007 21:32:45 +0100, "Tiarnan O'Corrain" <ocorrain <at> gmail.com> wrote:

> The flexi-streams test suite is failing on OpenMCL "Version 1.0
> (DarwinPPC32)" on
>
> Test "hebrew_utf8_lf.txt" (:UTF-8 :EOL-STYLE :LF) [INPUT]
>  --> (:UTF-8 :EOL-STYLE :LF) [OUTPUT].

Unfortunately, I don't have a Mac to investigate this, so we'll have
to look if someone else wants to try their luck.  Do you have at least
an error message?

> I think this is also preventing Hunchentoot from working on recent
> OpenMCL versions

Yes, I think so.
Tiarnan O'Corrain | 21 May 2007 23:40
Picon

Re: Flexi-streams test suite failing on OpenMCL

Hi Edi--

the error message is

value 1509 is not of the expected type (UNSIGNED-BYTE 8).
   [Condition of type TYPE-ERROR]

If you'd like me to try anything, or could point to an area of
investigation, let me know

regards

TiarnĂ¡n

On 5/21/07, Edi Weitz <edi <at> agharta.de> wrote:
> On Mon, 21 May 2007 21:32:45 +0100, "Tiarnan O'Corrain" <ocorrain <at> gmail.com> wrote:
>
> > The flexi-streams test suite is failing on OpenMCL "Version 1.0
> > (DarwinPPC32)" on
> >
> > Test "hebrew_utf8_lf.txt" (:UTF-8 :EOL-STYLE :LF) [INPUT]
> >  --> (:UTF-8 :EOL-STYLE :LF) [OUTPUT].
>
> Unfortunately, I don't have a Mac to investigate this, so we'll have
> to look if someone else wants to try their luck.  Do you have at least
> an error message?
>
> > I think this is also preventing Hunchentoot from working on recent
> > OpenMCL versions
>
(Continue reading)

Edi Weitz | 22 May 2007 08:38
Picon
Favicon

Re: Flexi-streams test suite failing on OpenMCL

On Mon, 21 May 2007 22:40:56 +0100, "Tiarnan O'Corrain" <ocorrain <at> gmail.com> wrote:

> the error message is
>
> value 1509 is not of the expected type (UNSIGNED-BYTE 8).
>    [Condition of type TYPE-ERROR]
>
> If you'd like me to try anything, or could point to an area of
> investigation, let me know

Hmm, and this happens in the STREAM-READ-CHAR method?  Could you try
to figure out what part of the program generates the 1509?
Tiarnan O'Corrain | 22 May 2007 20:13
Picon

Re: Flexi-streams test suite failing on OpenMCL

Hi Edi--

the SLIME inspector gives me this for the flexi-stream, and 1509=0x05e5 which is
"HEBREW LETTER FINAL TSADI".  It looks like OpenMCL is attempting to read
unicode rather than raw bytes.  Hmm...

An object.
 [type: FLEXI-STREAMS::FLEXI-UTF-8-INPUT-STREAM]
--------------------
Class: #<STANDARD-CLASS FLEXI-STREAMS::FLEXI-UTF-8-INPUT-STREAM>
--------------------
All Slots:
CLOSED          = NIL [set value] [make unbound]
DIRECTION       = :INPUT [set value] [make unbound]
ELEMENT-TYPE    = CHARACTER [set value] [make unbound]
EXTERNAL-FORMAT = #<EXTERNAL-FORMAT (:UTF-8 :EOL-STYLE :LF) #x8522FFE>
[set value] [make unbound]
LAST-CHAR-CODE  = 1509 [set value] [make unbound]
LAST-OCTET      = NIL [set value] [make unbound]
OCTET-STACK     = NIL [set value] [make unbound]
POSITION        = 3 [set value] [make unbound]
SHARED-RESOURCE = NIL [set value] [make unbound]
STREAM          = #<FILE-BINARY-INPUT-STREAM
("home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt"/8)
#x856FC86> [set value] [make unbound]

regards

TiarnĂ¡n
(Continue reading)

Edi Weitz | 22 May 2007 22:25
Picon
Favicon

Re: Flexi-streams test suite failing on OpenMCL

On Tue, 22 May 2007 19:13:10 +0100, "Tiarnan O'Corrain" <ocorrain <at> gmail.com> wrote:

> the SLIME inspector gives me this for the flexi-stream, and
> 1509=0x05e5 which is "HEBREW LETTER FINAL TSADI".  It looks like
> OpenMCL is attempting to read unicode rather than raw bytes.  Hmm...
>
> An object.
>  [type: FLEXI-STREAMS::FLEXI-UTF-8-INPUT-STREAM]
> --------------------
> Class: #<STANDARD-CLASS FLEXI-STREAMS::FLEXI-UTF-8-INPUT-STREAM>
> --------------------
> All Slots:
> CLOSED          = NIL [set value] [make unbound]
> DIRECTION       = :INPUT [set value] [make unbound]
> ELEMENT-TYPE    = CHARACTER [set value] [make unbound]
> EXTERNAL-FORMAT = #<EXTERNAL-FORMAT (:UTF-8 :EOL-STYLE :LF) #x8522FFE>
> [set value] [make unbound]
> LAST-CHAR-CODE  = 1509 [set value] [make unbound]
> LAST-OCTET      = NIL [set value] [make unbound]
> OCTET-STACK     = NIL [set value] [make unbound]
> POSITION        = 3 [set value] [make unbound]
> SHARED-RESOURCE = NIL [set value] [make unbound]
> STREAM          = #<FILE-BINARY-INPUT-STREAM
> ("home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt"/8)
> #x856FC86> [set value] [make unbound]

Very strange.  Could you confirm in the inspector that the underlying
stream is really a binary stream with element type (UNSIGNED-BYTE 8)?
And (using the debugger - I think, IIRC, you press v on the top frame)
could you try to find the exact place where the error occurs?
(Continue reading)

Tiarnan O'Corrain | 22 May 2007 23:22
Picon

Re: Flexi-streams test suite failing on OpenMCL

Hi--

> Very strange.  Could you confirm in the inspector that the underlying
> stream is really a binary stream with element type (UNSIGNED-BYTE 8)?

Here's the description of the underlying stream from the slime
inspector -- I can't
inspect this stream itself in slime...

#<FILE-BINARY-INPUT-STREAM
("home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt"/10)
#x8557786>
Class: #<STANDARD-CLASS CCL::FILE-BINARY-INPUT-STREAM>
Wrapper: #<CCL::CLASS-WRAPPER CCL::FILE-BINARY-INPUT-STREAM #x810DDF6>
Instance slots
CCL::DIRECTION: :INPUT
CCL::CLOSED: NIL
CCL::SHARED-RESOURCE: NIL
CCL::IOBLOCK: #S(CCL::FILE-IOBLOCK :STREAM #<FILE-BINARY-INPUT-STREAM
("home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt"/10)
#x8557786>
                                   :UNTYI-CHAR NIL
                                   :INBUF #<IO-BUFFER  (UNSIGNED-BYTE
                                                        8) 3/2048/2048
#x85576F6>
                                   :OUTBUF NIL
                                   :ELEMENT-TYPE (INTEGER 0 255)
                                   :ELEMENT-SHIFT 0
                                   :CHARPOS 0
                                   :DEVICE 10
(Continue reading)

Edi Weitz | 23 May 2007 00:25
Picon
Favicon

Re: Flexi-streams test suite failing on OpenMCL

On Tue, 22 May 2007 22:22:13 +0100, "Tiarnan O'Corrain" <ocorrain <at> gmail.com> wrote:

> Here's the description of the underlying stream from the slime
> inspector -- I can't inspect this stream itself in slime...

That looks correct.

>> And (using the debugger - I think, IIRC, you press v on the top
>> frame) could you try to find the exact place where the error
>> occurs?
>
> the error is occurring in input.lisp, when stream-read-char is
> called from compare-files in test.lisp.

No, I meant where /in/ STREAM-READ-CHAR.  Doesn't SLIME locate a
particular form in the function's definition?  (Maybe it can't due to
the macrology, dunno.)

Thanks,
Edi.

Gmane