John Daggett | 29 Jun 2012 07:14

[css3-writing-modes] vertical orientation and UTR50


The current draft of the CSS3 Writing Modes spec defines the values
for the 'text-orientation' property based on the proposed vertical
orientation properties in Unicode [1].  Specifically, 'mixed-right' is
defined to be based on the mixed vertical orientation property value
(MVO) and 'upright' is based on the stacked vertical orientation
property value (SVO).  This makes sense and I completely agree with
this.

However, in section 5.1.1 [2] the spec defines these in terms of
variations on the proposed UTR50 versions of these properties, using
the terms MVOsimple and SVOsimple.  It links to a data file on
csswg.org which contains values that are different from the current
data file associated with Draft 5 of UTR50.  Elika says these are
edits that have already been generally agreed upon but have not yet been
published in a UTR50 draft.

I really, really, really don't like the idea of publishing our own
variation of UTR50.  Right now there's considerable discussion in
Japan via twitter etc of UTR50 [3] and the role of MVO/SVO in vertical
text layout.  I think some of this discussion may just be
misunderstanding about the intent and utility of UTR50 data but I
think part of it may be valid criticism that leads to
changes/restructuring of the data.  I think we should let that
discussion influence definition of UTR50 and not introduce more noise
into an already noisy discussion.  The proper place for discussion of
these details is in the Unicode forum for UTR50, not on www-style.

I realize that applications are being written that diverge in
behavior [4] and that some sort of convergence is necessary for
(Continue reading)

Koji Ishii | 29 Jun 2012 10:31
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> The current draft of the CSS3 Writing Modes spec defines the values for the
> 'text-orientation' property based on the proposed vertical orientation properties in
> Unicode [1].  Specifically, 'mixed-right' is defined to be based on the mixed vertical
> orientation property value
> (MVO) and 'upright' is based on the stacked vertical orientation property value (SVO).
> This makes sense and I completely agree with this.

Great to hear that, thank you.


> However, in section 5.1.1 [2] the spec defines these in terms of variations on the
> proposed UTR50 versions of these properties, using the terms MVOsimple and
> SVOsimple.  It links to a data file on csswg.org which contains values that are
> different from the current data file associated with Draft 5 of UTR50.  Elika says
> these are edits that have already been generally agreed upon but have not yet been
> published in a UTR50 draft.
> 
> I really, really, really don't like the idea of publishing our own variation of UTR50.
> Right now there's considerable discussion in Japan via twitter etc of UTR50 [3] and the
> role of MVO/SVO in vertical text layout.  I think some of this discussion may just be
> misunderstanding about the intent and utility of UTR50 data but I think part of it may
> be valid criticism that leads to changes/restructuring of the data.  I think we should
> let that discussion influence definition of UTR50 and not introduce more noise into an
> already noisy discussion.  The proper place for discussion of these details is in the
> Unicode forum for UTR50, not on www-style.

It's not a variation, it's a snapshot. It's true that fantasai and I have a different table at wiki, and that
there are a lot of conversation going on, but the data in the ED is based on the draft #5 plus only changes that
were discussed with Eric and Microsoft. It's not from our table on the wiki. I'm sorry if this wasn't clear,
I hope this clears some of the concerns you have. Neither fantasai nor I have intention to use our ED/WD to
(Continue reading)

John Daggett | 29 Jun 2012 11:00

Re: [css3-writing-modes] vertical orientation and UTR50

Koji Ishii wrote:

> It's not a variation, it's a snapshot. It's true that fantasai and I
> have a different table at wiki, and that there are a lot of
> conversation going on, but the data in the ED is based on the draft
> #5 plus only changes that were discussed with Eric and Microsoft.
> It's not from our table on the wiki. I'm sorry if this wasn't clear,
> I hope this clears some of the concerns you have. Neither fantasai
> nor I have intention to use our ED/WD to influence UTR50 at all, and
> we fully agree with you that doing so is really a bad idea.

Then we should request another UTR50 draft containing the changes and
use that.  I am very strongly against defining something that looks
like a delta on top of the UTR50 proposal.  There is absolutely no
reason to rush to publish something based on preliminary edits that
have not necessarily converged to their final form.

> > It would be much better for this part of the spec to define the
> > behavior of 'mixed-right' and 'upright' given the specific values of
> > the MVO/SVO properties defined in UTR50 (i.e. R, T, Tr, Tu, U). The
> > spec contains the wording below but in an informative note that
> > doesn't fully explain how the logic is to be used:
> > :
> > Proposed replacement:
> > :
> 
> I'm not sure if I understand your concern here very well, can you explain a bit more please?
> 
> I hope you agreed to take a snapshot by now. Assuming so, is your concern:
> 
(Continue reading)

Koji Ishii | 29 Jun 2012 11:43
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> Then we should request another UTR50 draft containing the changes and use that.  I
> am very strongly against defining something that looks like a delta on top of the UTR50
> proposal.  There is absolutely no reason to rush to publish something based on
> preliminary edits that have not necessarily converged to their final form.

First, we resolved to put our own table in the writing-modes spec[1]:

> - RESOLVED: put our own table of behaviors for mixed-right and upright
>               values in the writing-modes spec until UTR50 stabilizes

Second. It's very unfortunate but there's a reason. The next draft has to wait for the next UTC conference at
30th Jul. If we asked vendors and publishers to wait for it, they said they'll go with the current WebKit
implementation. I tried draft #5 too, but it didn't work either because it has too critical errors to use in CJK.

It is our goal to avoid spreading files that depends on a specific implementation, I hope you agree with
this, and I think this is the only way to avoid it.


> I don't understand what you mean by "derived property" here.  The existing text is
> non-normative and does not sufficiently explain how the values of the SVO/MVO map
> to the actual placement of glyphs in vertical text runs.

I meant "derived property" as defined by UAX#44[2].

The normative part of 5.1.1. Vertical Orientations[3] defines two derived properties, and defines how UA
must render using them. I think this part is clear and sufficient for both implementers and authors. Are we
agree on this?

You're right that how to derive is non-normative. I intentionally did so because of the instability of the
UTR50. We're still not sure proposed values like IR/IU will make it or not. UTR50 may introduce more values
(Continue reading)

Glenn Adams | 29 Jun 2012 16:50
Gravatar

Re: [css3-writing-modes] vertical orientation and UTR50


On Fri, Jun 29, 2012 at 3:43 AM, Koji Ishii <kojiishi <at> gluesoft.co.jp> wrote:
> Then we should request another UTR50 draft containing the changes and use that.  I
> am very strongly against defining something that looks like a delta on top of the UTR50
> proposal.  There is absolutely no reason to rush to publish something based on
> preliminary edits that have not necessarily converged to their final form.

First, we resolved to put our own table in the writing-modes spec[1]:

> - RESOLVED: put our own table of behaviors for mixed-right and upright
>               values in the writing-modes spec until UTR50 stabilizes

I believe this is a very bad idea, and should be abrogated. It will only lead to divergence.
 
Second. It's very unfortunate but there's a reason. The next draft has to wait for the next UTC conference at 30th Jul. If we asked vendors and publishers to wait for it, they said they'll go with the current WebKit implementation. I tried draft #5 too, but it didn't work either because it has too critical errors to use in CJK.

We should simply reference the UTR data even if it changes. The implementors can address such changes as needed.

Sylvain Galineau | 29 Jun 2012 18:47
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50



[Glenn Adams:]

>> - RESOLVED: put our own table of behaviors for mixed-right and upright
>>               values in the writing-modes spec until UTR50 stabilizes

>I believe this is a very bad idea, and should be abrogated. It will only lead to divergence.

>We should simply reference the UTR data even if it changes. The implementors can address such changes as needed.

I agree with John and Glenn's overall position. We should refer to UTR50, not snapshot it. I also recall
the resolution and yes, it somehow made sense at the time. But since: 

1. The resolution implicitly states we *will* reference UTR50 ('...until UTR50 stabilizes')
2. Maintaining a separate snapshot can only lead to confusion for implementors and authors alike
3. Minimizing this potential confusion ought to be more work for the editors

Simply referencing this document seems the way to go.


Alan Stearns | 29 Jun 2012 19:22
Picon
Favicon

Re: [css3-writing-modes] vertical orientation and UTR50

On 6/29/12 9:47 AM, "Sylvain Galineau" <sylvaing <at> microsoft.com> wrote:

>
>
>[Glenn Adams:]
>
>>> - RESOLVED: put our own table of behaviors for mixed-right and upright
>>>               values in the writing-modes spec until UTR50 stabilizes
>
>>I believe this is a very bad idea, and should be abrogated. It will only
>>lead to divergence.
>
>>We should simply reference the UTR data even if it changes. The
>>implementors can address such changes as needed.
>
>I agree with John and Glenn's overall position. We should refer to UTR50,
>not snapshot it. I also recall
>the resolution and yes, it somehow made sense at the time. But since:
>
>1. The resolution implicitly states we *will* reference UTR50 ('...until
>UTR50 stabilizes')
>2. Maintaining a separate snapshot can only lead to confusion for
>implementors and authors alike
>3. Minimizing this potential confusion ought to be more work for the
>editors
>
>Simply referencing this document seems the way to go.

Chiming in with my belated objection to this resolution as well. Since the
face-to-face I've talked to Nat McCully who convinced me it would be
better to wait for UTR50 than introduce yet another interim solution.

Thanks,

Alan

Koji Ishii | 29 Jun 2012 20:23
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> Chiming in with my belated objection to this resolution as well. Since the face-to-face
> I've talked to Nat McCully who convinced me it would be better to wait for UTR50 than
> introduce yet another interim solution.

I understand many don't like this option. But we need to consider this case with what will happen in mind.

Before the Hamburg, I know a couple of publishers told some vendors to follow WebKit's behavior or they
wouldn't ship contents for the rendering engines. After the Hamburg, they applauded our resolution, and
did really a hard work to follow us in the last minutes.

Two months later, if the WG wants to cancel the resolution, I don't know exactly what will happen. Maybe some
of them go back to WebKit. Maybe some of them ignore the cancellation. Maybe some of them take a different
snapshot of UTR with their own fixes. It will just go back to UA dependent which the WG disliked at Hamburg.
Tens of thousands of e-books in HTML/CSS will be created for some implementers and others will be kicked
out. The only thing that is clear to me is that nobody will wait for us.

Sometime ago, Ted tweeted about HTML design principles[1], which I didn't know about. It's not ours, but I
liked it very much. I hope you like it too.

Regards,
Koji

[1] http://www.w3.org/TR/html-design-principles/#priority-of-constituencies

Koji Ishii | 29 Jun 2012 19:27
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> >We should simply reference the UTR data even if it changes. The implementors can
> >address such changes as needed.
> 
> I agree with John and Glenn's overall position. We should refer to UTR50, not snapshot
> it. I also recall
> the resolution and yes, it somehow made sense at the time. But since:
> 
> 1. The resolution implicitly states we *will* reference UTR50 ('...until UTR50
> stabilizes')
> 2. Maintaining a separate snapshot can only lead to confusion for implementors and
> authors alike
> 3. Minimizing this potential confusion ought to be more work for the editors
> 
> Simply referencing this document seems the way to go.

Can I ask then what authors should do today? The question we were given at Hamburg was, do we want them to
create tens of thousands of HTML/CSS files based on WebKit's implementation, or do we want to publish our
own table.

I assume you're not recommending WebKit given recent discussion on mobile web. I also assume you don't like
UA dependent, which I originally proposed. I can't see what your answer is.

If I understand correctly, our ultimate goal is to maximize the interoperability of the Web technologies,
so that authors can trust us. So that later implementations can enjoy existing contents. So that users
have maximum freedom to choose their favorite browsers to view contents.

I don't think the resolution does anything wrong to the goal.


Regards,
Koji

Sylvain Galineau | 29 Jun 2012 20:50
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50


[Koji Ishii:]
> 
> Can I ask then what authors should do today? The question we were given at
> Hamburg was, do we want them to create tens of thousands of HTML/CSS files
> based on WebKit's implementation, or do we want to publish our own table.

I don't understand this argument at all. Because some early adopters
have no qualms about taking a hard WebKit dependency we should align with
this implementation even though it already diverges from where Unicode 
is going ?
 
You can't spec early adopters out of doing anything. Your job as editor
is to specify a solution for everyone else. Forking our own bits
of Unicode to placate some early adopters is absolutely not an option imo. 
Publishers are free to take any dependency on WebKit they like; but they 
simply cannot count on Unicode or W3C pre-emptively declaring that choice 
to be conformant. 

Now, were we to reach a point where multiple browser implementations converged 
and handled the same content in a compatible manner *AND* UTR50 diverged from
them then you'd have a somewhat reasonable rationale for *considering* something 
like this as an interim spec fix. But even then, what would it solve? We *cannot* 
fork Unicode. 

And when it comes to Unicode, content is not just web pages. Having browsers 
process Unicode vertical orientation one way while other Unicode processing 
software - e.g. operating system libraries, word processors, formats such as PDF - 
does it differently is too painful to contemplate.

> 
> I assume you're not recommending WebKit given recent discussion on mobile
> web. 

This is a standard WG. Our job is not to recommend WebKit, Trident, Presto or 
Gecko; our job is to recommend what all these and others should do for the
web, not just the 'mobile' web. 

> I also assume you don't like UA dependent, which I originally
> proposed. I can't see what your answer is.

Early implementations will almost always have UA-dependent behavior, 
and early adopters will come to depend on some of these. Our job is to 
minimize - if not eliminate - UA dependencies from future content and
implementations. Diverging from another standard body's ongoing work
due to a single early implementation is not a good way to achieve that.

> 
> If I understand correctly, our ultimate goal is to maximize the
> interoperability of the Web technologies, so that authors can trust us. So
> that later implementations can enjoy existing contents. So that users have
> maximum freedom to choose their favorite browsers to view contents.

What existing content are we talking about? 'What a lot of content would look
like if it conforms to the last WebKit nightly' does not qualify as 'existing 
content'. If some ebook publishers want to depend on WebKit's implementation, 
they're welcome to. If that turns out to be incompatible in the future then 
they'll need to deal with the legacy they chose to create. Such is life.

> 
> I don't think the resolution does anything wrong to the goal.
> 
If the DWrite team builds UTR50 support and I can't also conform to your draft 
without special-casing their work I'll have to disagree and formally object.

So. If you think WebKit's current support should be the standard then you need to
convince the folks who write UTR50 to agree. Pretending they already have by 
maintaining your own copy is not the way to go.

Sylvain Galineau | 29 Jun 2012 22:04
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

Following up on this it seems I'm misunderstanding the problem i.e. 
we're not really standardizing what one particular engine is doing 
at the moment - good! - but we are defining a solution so as to 
prevent some early adopters from depending on this engine. Said 
solution derives from work in progress at Unicode; moreover, some 
content creators expect that whatever content they produce that
conforms to our draft will be stable i.e. future UTR50 implementations
will not conflict with content. If so, that still seems dangerous 
for all the same reasons. I do not think it is wise to have our 
own UTR50 fork, however temporarily that may be; *especially* if 
we know some publishers mean to treat our *draft* and the UTR50 
snapshot contained therein as a standard. This sounds confusing, 
if not misleading. I would not want us to support such an 
expectation without explicit agreement from our Unicode partners. 
And if we have such agreement then I really don't understand why 
we need our own copy...?
Koji Ishii | 29 Jun 2012 23:04
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

Oh, I missed this one before sending the last mail, sorry about that.

> Following up on this it seems I'm misunderstanding the problem i.e.
> we're not really standardizing what one particular engine is doing
> at the moment - good!

Wonderful to hear that, thank you.

> - but we are defining a solution so as to
> prevent some early adopters from depending on this engine. Said
> solution derives from work in progress at Unicode; moreover, some
> content creators expect that whatever content they produce that
> conforms to our draft will be stable i.e. future UTR50 implementations
> will not conflict with content.

I don't think the last part is true. The spec clearly says "we will be tracking changes."[1]

Well, "some" may be true because not everyone reads specs. Could be "many." But as I wrote in my previous
mail, we could work on versioning scheme and define how to migrate old contents to new one with some
transition period, if the WG agrees with it.


> If so, that still seems dangerous
> for all the same reasons. I do not think it is wise to have our
> own UTR50 fork, however temporarily that may be; *especially* if
> we know some publishers mean to treat our *draft* and the UTR50
> snapshot contained therein as a standard. This sounds confusing,
> if not misleading. I would not want us to support such an
> expectation without explicit agreement from our Unicode partners.
> And if we have such agreement then I really don't understand why
> we need our own copy...?

Here's a screenshot of e-book readers today[2] -- they're not CSS-based, but I hope you can see how
orientations vary by readers. Contents today is very low in volume, but we expect tens of thousands of
contents being created in the coming 6 months, and authors need something to rely on. Does this explain the
need to have a snapshot?

Now, please allow me to ask questions to make sure if I understand you correctly, because this one seems to be
especially important, and I can't be confident on my English skills. Sorry for bothering.

1. You may be ok if temporarily -- temporarily do you mean by the final of UTR50, correct?

2. You may be ok if we don't have to support such an expectation, or if we have explicit agreement from our
Unicode partners. Correct?

3. I didn't understand what the "such an expectation" is. Did you mean if we can come up with good wordings to
make sure what we have in the draft is temporarily until UTR50 becomes final, final UTR50 is very likely to
have different values, and support for the current table will be deprecated in future?

4. Does "explicit agreement from our Unicode partners" mean we get explicit agreement from Eric, the
editor of the UTR50, to have a snapshot in our spec?

5. Assuming 3 and 4 are correct, allow me to double-confirm; are they OR? I mean, you can live with either, or
do you require both?

[1] http://dev.w3.org/csswg/css3-writing-modes/#vertical-orientations

[2] http://twitpic.com/a180ys


Regards,
Koji

Sylvain Galineau | 30 Jun 2012 01:37
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50


[Koji Ishii:]
> 
> Oh, I missed this one before sending the last mail, sorry about that.
No worries, that was my bad. I'll just answer to this response if that's
OK.
> 
> > Following up on this it seems I'm misunderstanding the problem i.e.
> > we're not really standardizing what one particular engine is doing at
> > the moment - good!
> 
> Wonderful to hear that, thank you.
> 
> > - but we are defining a solution so as to prevent some early adopters
> > from depending on this engine. Said solution derives from work in
> > progress at Unicode; moreover, some content creators expect that
> > whatever content they produce that conforms to our draft will be
> > stable i.e. future UTR50 implementations will not conflict with
> > content.
> 
> I don't think the last part is true. The spec clearly says "we will be
> tracking changes."[1]

You said we resolved to do this to help publishers produce content that does 
not depend on some specific engine, right? And these publishers were happy
when we did. Are they going to be happy when these changes we are tracking 
invalidate some of their content? If they don't care about tomorrow's engines 
rendering today's content differently then I don't understand what problem we're 
trying to solve by hosting this snapshot; if, on the other hand, these publishers 
do expect the content they are producing today to render the same in future engines 
that conform to css3-writing-modes and UTR50 then I do not understand how making 
our own copy of UTR50 fulfills that expectation. Unless we plan on ignoring those 
UTR50 changes that would break existing content. As the latter would amount of 
forking a Unicode spec and that seems a horrible idea I want to make sure I
understand why we're doing this. I clearly thought I did at the time; I no longer
do.

> 
> Well, "some" may be true because not everyone reads specs. Could be "many."
> But as I wrote in my previous mail, we could work on versioning scheme and
> define how to migrate old contents to new one with some transition period,
> if the WG agrees with it.

This is something the WG may do between levels of a spec. We do not and should
not version between drafts. That is the responsibility of whoever wants to implement
them. 

> 
> 
> > If so, that still seems dangerous
> > for all the same reasons. I do not think it is wise to have our own
> > UTR50 fork, however temporarily that may be; *especially* if we know
> > some publishers mean to treat our *draft* and the UTR50 snapshot
> > contained therein as a standard. This sounds confusing, if not
> > misleading. I would not want us to support such an expectation without
> > explicit agreement from our Unicode partners.
> > And if we have such agreement then I really don't understand why we
> > need our own copy...?
> 
> Here's a screenshot of e-book readers today[2] -- they're not CSS-based, but
> I hope you can see how orientations vary by readers. Contents today is very
> low in volume, but we expect tens of thousands of contents being created in
> the coming 6 months, and authors need something to rely on. Does this
> explain the need to have a snapshot?

It explains why we need UTR50 and css3-writing-modes. It does not explain why 
we need a copy of UTR50 into our own draft. 

> 
> Now, please allow me to ask questions to make sure if I understand you
> correctly, because this one seems to be especially important, and I can't be
> confident on my English skills. Sorry for bothering.
> 
> 1. You may be ok if temporarily -- temporarily do you mean by the final of
> UTR50, correct?

'However temporarily that may be' means no, I'm not OK with keeping a copy of
UTR50 in our own specs at all. I don't think we should copy/paste other specs or 
modules we depend on into our own. 

> 
> 2. You may be ok if we don't have to support such an expectation, or if we
> have explicit agreement from our Unicode partners. Correct?

I am saying it is up to Unicode to define UTR50 and indicate whether it is stable 
enough for implementation by publishers or anyone else; we should not be the ones 
saying or implying that imo. Note that I'm not sure we are doing so; but that is 
what I am *perceiving* from your explanation i.e. we do this so publishers who want
to produce e-books today have a one-stop spec to work with. I have a hard time 
assuming said publishers do not also expect future css3-writing-modes drafts - and 
thus UTR50 if we carry that along - to be backward compatible with their content.

> 
> 3. I didn't understand what the "such an expectation" is. Did you mean if we
> can come up with good wordings to make sure what we have in the draft is
> temporarily until UTR50 becomes final, final UTR50 is very likely to have
> different values, and support for the current table will be deprecated in
> future?

I am saying css3-writing-modes should not set any expectations about UTR50's 
completeness or stability, or confuse anyone about the dependency of one spec
on the other by including a copy that may or may not be up to date. 

> 
> 4. Does "explicit agreement from our Unicode partners" mean we get explicit
> agreement from Eric, the editor of the UTR50, to have a snapshot in our
> spec?

Er, you mean you haven't asked? Yeah, assuming there ever is a good reason to
snapshot some other standard body's spec into our own I think we should ask...

> 
> 5. Assuming 3 and 4 are correct, allow me to double-confirm; are they OR? I
> mean, you can live with either, or do you require both?

I am trying to understand why we want to have a snapshot of UTR50 in a CSSWG
draft. I do not understand the need or benefits. I do see plenty of potential
downside.

> 
> [1] http://dev.w3.org/csswg/css3-writing-modes/#vertical-orientations

> [2] http://twitpic.com/a180ys

> 
> Regards,
> Koji

Sylvain Galineau | 30 Jun 2012 03:42
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50



> > Well, "some" may be true because not everyone reads specs. Could be
> "many."
> > But as I wrote in my previous mail, we could work on versioning scheme
> > and define how to migrate old contents to new one with some transition
> > period, if the WG agrees with it.
> 
> This is something the WG may do between levels of a spec. We do not and
> should not version between drafts. That is the responsibility of whoever
> wants to implement them.
> 
On a second read, strike that. The CSSWG should not be versioning or deprecating
a Unicode feature. Deprecated features still require implementation work; depending
on implementors supporting one or more deprecated variants of a feature at WD stage
would be a significant red flag. 

The note in 5.1.1 that John referred to thankfully suggests that is not the goal. 
Moreover, as it also suggests that these properties are directly derived from other 
Unicode properties that UTR50 does define I agree with John that we should define 
the mapping we assume normatively. And we should not host our own version of this data. 
Koji Ishii | 30 Jun 2012 10:56
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> On a second read, strike that. The CSSWG should not be versioning or deprecating a
> Unicode feature. Deprecated features still require implementation work; depending
> on implementors supporting one or more deprecated variants of a feature at WD
> stage would be a significant red flag.
> 
> The note in 5.1.1 that John referred to thankfully suggests that is not the goal.
> Moreover, as it also suggests that these properties are directly derived from other
> Unicode properties that UTR50 does define I agree with John that we should define the
> mapping we assume normatively. And we should not host our own version of this data.

As in my previous mail, versioning is not my priority. Technologies using CSS already have one, so it's
really a question whether web wants it or not.

If the web does not want, I'm happy with that. We can just update the table to refer to UTR50 when it goes final.


Regards,
Koji

Sylvain Galineau | 30 Jun 2012 18:09
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50


[Koji Ishii:]
> 
> If the web does not want, I'm happy with that. We can just update the
> table to refer to UTR50 when it goes final.
> 
Waiting for UTR50 to go final is what you're doing now. What we are suggesting
is that you should no do that. Instead: 
1. Refer to UTR50 now; specifically, do not refer to your own hosted copy
of the UTR50 data on w3.org
2. Define the mapping of MVOsimple and SVOsimple in terms of MVO and SVO
normatively (it currently is in a note).

In other words tell implementors how they can generate their own vosimple.txt
and leave it at that. 

Does that clarify the expectation?
Glenn Adams | 30 Jun 2012 18:52
Gravatar

Re: [css3-writing-modes] vertical orientation and UTR50


On Sat, Jun 30, 2012 at 10:09 AM, Sylvain Galineau <sylvaing <at> microsoft.com> wrote:

[Koji Ishii:]
>
> If the web does not want, I'm happy with that. We can just update the
> table to refer to UTR50 when it goes final.
>
Waiting for UTR50 to go final is what you're doing now. What we are suggesting
is that you should no do that. Instead:

s/no do/not do/
 
1. Refer to UTR50 now; specifically, do not refer to your own hosted copy
of the UTR50 data on w3.org

s/w3.org/w3.org, but instead refer to the UTR5 draft document directly/
 

2. Define the mapping of MVOsimple and SVOsimple in terms of MVO and SVO
normatively (it currently is in a note).

In other words tell implementors how they can generate their own vosimple.txt
and leave it at that.

Does that clarify the expectation?

Koji Ishii | 30 Jun 2012 20:20
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> Waiting for UTR50 to go final is what you're doing now. What we are suggesting
> is that you should no do that. Instead:
> 1. Refer to UTR50 now; specifically, do not refer to your own hosted copy
> of the UTR50 data on w3.org
> 2. Define the mapping of MVOsimple and SVOsimple in terms of MVO and SVO
> normatively (it currently is in a note).
> 
> In other words tell implementors how they can generate their own vosimple.txt
> and leave it at that.
> 
> Does that clarify the expectation?

Yeah, that's clear, thank you.

For #2, I'm good with that.

For #1, it looks strange to me. When EPUB WG came to us and wanted to refer our WDs two years ago, didn't we
recommend not to do that because WDs could possibly change drastically? Didn't we recommend them to refer
at least a dated version, or even have a copy rather than moving target if they have to use WDs? It looks to me
that what you're recommending is to do exactly what we asked EPUB WG not to do. Did I miss something here?


Regards,
Koji

Sylvain Galineau | 1 Jul 2012 00:23
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50


[Koji Ishii:] 
> For #1, it looks strange to me. When EPUB WG came to us and wanted to
> refer our WDs two years ago, didn't we recommend not to do that because
> WDs could possibly change drastically? Didn't we recommend them to refer
> at least a dated version, or even have a copy rather than moving target if
> they have to use WDs? It looks to me that what you're recommending is to
> do exactly what we asked EPUB WG not to do. Did I miss something here?
> 
> 
As I recall, EPUB was not just referring to our specs but defined their
format in terms of specific draft versions of our own i.e. they specified
a CSS profile that included work in progress. For instance, EPUB30 
specifically refers to the 3/24/11 version of CSS3 Fonts for the syntax 
of that feature [1]. This means future CSS working draft updates could 
introduce breaking changes for EPUB, prevent EPUB implementors from using 
standard engines, require a browser engine wishing to support EPUB to implement
and maintain a different version of a given property etc. As Tab would say, 
such a situation is fraught with footguns. We had a similar scenario with 
a different consortium that took a dependency on working and editor's drafts 
and formally objected to our making a change.

So yes, you could say the intent here is to *not* put ourselves in EPUB's 
position vis-a-vis Unicode. We do not want to depend on a specific version
of UTR50, or of its data. Does that make sense?

[1] http://idpf.org/epub/30/spec/epub30-contentdocs.html#sec-css-profile


Koji Ishii | 2 Jul 2012 17:26
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

Sorry for the late reply, I'm mostly out this week and tend to be late.

It looks like discussion is a little diverged, but allow me to back to Sylvain's original proposal:

> 1. Refer to UTR50 now; specifically, do not refer to your own hosted copy
> of the UTR50 data on w3.org

After re-reviewing where we're, I'm all good with this proposal.

> 2. Define the mapping of MVOsimple and SVOsimple in terms of MVO and SVO
> normatively (it currently is in a note).

This one turned out to have one issue; the current text has "scripts like Mongolian," which looks ambiguous
to me to make it normative. I'd like it be very specific so that everyone can get the same result, and I think
"like Mongolian" isn't enough for the purpose. I think the HO property serves the best for that purpose. If
there were any objections to do so, please let me know.

> So yes, you could say the intent here is to *not* put ourselves in EPUB's position
> vis-a-vis Unicode. We do not want to depend on a specific version of UTR50, or of its
> data. Does that make sense?

Yes, thank you for the detailed explanations and for Glenn helping me a lot behind the scenes.

It's irrelevant now I guess but I'd like to make just one thing very clear for the honor of fantasai and me;
neither fantasai nor I have any intention to diverge from Unicode. As I wrote, what we put in the ED is from
draft #5 and only changes that were discussed with UTC folks. It's not our table. It's not WebKit table. It
has no our speculations. It's not any several different opinions from Japan. It is just a snapshot, and
also as stated in the spec, we were to follow UTR#50 as it is updated, so we didn't have any intention to diverge.

The situation was a little different at Hamburg, when UTR#50 was draft #4, but Eric, fantasai, Lanrentiau,
and Dwayne made remarkable progress since then, and we had resolved most of critical issues for East Asian
scripts. All these resolutions are minuted and expected to be put into the next draft, so there's not much
differences between snapshotting and referring once the next draft is out. So, back to the top of this
mail, I'm all good with Sylvain's proposal. I was neglecting to re-review our strategy after the
situation was changed, and thank you for reminding that to us.


Regards,
Koji

Sylvain Galineau | 2 Jul 2012 19:49
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50


[Koji Ishii:] 
> It's irrelevant now I guess but I'd like to make just one thing very clear
> for the honor of fantasai and me; neither fantasai nor I have any intention
> to diverge from Unicode. 

I hope not! :) And neither does the WG. I'm concerned about any appearance we
might, if only because we do at the moment. Vague explanations about publishers
needing this to create content in the next six months, followed  by chatter of
'versioning' or 'deprecation' did little to dispel the perception on my end that
we might be setting some expectations. I think there is no better way to indicate
there is no divergence than referring to the Unicode spec.

>This one turned out to have one issue; the current text has "scripts like Mongolian," 
>which looks ambiguous to me to make it normative. I'd like it be very specific so 
>that everyone can get the same result
Sure, whatever it takes to allow interested parties to generate the proper intended
data is fine.


John Daggett | 3 Jul 2012 03:21

Re: [css3-writing-modes] vertical orientation and UTR50


Koji Ishii wrote:

> > 2. Define the mapping of MVOsimple and SVOsimple in terms of MVO
> > and SVO normatively (it currently is in a note).
> 
> This one turned out to have one issue; the current text has "scripts
> like Mongolian," which looks ambiguous to me to make it normative.
> I'd like it be very specific so that everyone can get the same
> result, and I think "like Mongolian" isn't enough for the purpose. I
> think the HO property serves the best for that purpose. If there
> were any objections to do so, please let me know.

I don't think there's a need for a separate HO property and have
posted a message in the UTR50 forum stating this. [1]  In fact,
there's no role for HO in defining the behavior of the
'text-orientation' property since this property only affects vertical
runs, *not* horizontal runs.  So the sentence starting with "The one
exception..." can be omitted entirely.  In vertical runs, Mongolian
and Phags-pa are displayed upright, just as the MVO/SVO reflects.

The spec needs to normatively refer to MVO and SVO (*not* derived
properties) and let the Unicode discussions resolve the issue of which
values apply to specific codepoints.

Taro Yamamoto from Adobe, who attended the F2F in Kyoto last year, has
posted a very lucid document concerning MVO values.  I think it
reflects nicely some of the concerns of the Japanese typographic
community:

http://blogs.adobe.com/CCJKType/files/2012/07/TaroUTR50SortedList112.pdf

UTR50 forum posting: http://unicode.org/forum/viewtopic.php?f=35&t=340

Regards,

John Daggett

[1] http://unicode.org/forum/viewtopic.php?f=35&t=342

Koji Ishii | 3 Jul 2012 13:21
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> I don't think there's a need for a separate HO property and have posted a message
> in the UTR50 forum stating this. [1]  In fact, there's no role for HO in defining the
> behavior of the 'text-orientation' property since this property only affects vertical
> runs, *not* horizontal runs.  So the sentence starting with "The one exception..." can
> be omitted entirely.  In vertical runs, Mongolian and Phags-pa are displayed upright,
> just as the MVO/SVO reflects.

Well, you know far more on Mongolian than I do, so I'd like to trust you, but other two I also trust --
Laurentiau and fantasai think Mongolian and Phags-pa should be rendered rotated, so I hope you can find a
consensus in the forum. I guess it's just difference of visual orientations and rendering orientations,
maybe wrong, but it's a UTC's issue.

HO was resolved on the last UTC conference, it may not survive as you say, but we can remove from our spec if
they were removed from UTR#50. We were there too, and supported the resolution, so not using HO looks
strange to me. I was ok either if it was an informative text, but if the text is normative, I think we should
follow UTC's resolution.


> The spec needs to normatively refer to MVO and SVO (*not* derived
> properties) and let the Unicode discussions resolve the issue of which values apply to
> specific codepoints.

Agreed, I was thinking the same. Since we don't take snapshot any longer, we don't need simple versions.


> Taro Yamamoto from Adobe, who attended the F2F in Kyoto last year, has posted a
> very lucid document concerning MVO values.  I think it reflects nicely some of the
> concerns of the Japanese typographic
> community:
> http://blogs.adobe.com/CCJKType/files/2012/07/TaroUTR50SortedList112.pdf

> UTR50 forum posting: http://unicode.org/forum/viewtopic.php?f=35&t=340


Yeah, a few in Japan agree with him, and I reported that before to the UTC. Now he wrote by himself, it's good. I
don't agree with his opinion, but it's a UTC issue, not a CSS issue, right?


Regards,
Koji

John Daggett | 3 Jul 2012 14:10

Re: [css3-writing-modes] vertical orientation and UTR50


Koji Ishii wrote:

> > I don't think there's a need for a separate HO property and have
> > posted a message in the UTR50 forum stating this. [1]  In fact,
> > there's no role for HO in defining the behavior of the
> > 'text-orientation' property since this property only affects
> > vertical runs, *not* horizontal runs.  So the sentence starting
> > with "The one exception..." can be omitted entirely.  In vertical
> > runs, Mongolian and Phags-pa are displayed upright, just as the
> > MVO/SVO reflects.
> 
> Well, you know far more on Mongolian than I do, so I'd like to trust
> you, but other two I also trust -- Laurentiau and fantasai think
> Mongolian and Phags-pa should be rendered rotated, so I hope you can
> find a consensus in the forum. I guess it's just difference of
> visual orientations and rendering orientations, maybe wrong, but
> it's a UTC's issue.

Koji, are you sure this is what they are thinking?  These are
*vertical* text runs we're talking about in the context of
text-orientation.

> HO was resolved on the last UTC conference, it may not survive as
> you say, but we can remove from our spec if they were removed from
> UTR#50. We were there too, and supported the resolution, so not
> using HO looks strange to me. I was ok either if it was an
> informative text, but if the text is normative, I think we should
> follow UTC's resolution.

Look at the data, no implementation needs to use that data, they will
realize immediately that the data reduces to "if the script is
Mongolian or Phags-pa handle the horizontal case differently".

I'm completely at a loss to understand why you requested a separate
property value when expressing that very simple condition is
sufficient.

John Daggett

Koji Ishii | 3 Jul 2012 14:58
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> I'm completely at a loss to understand why you requested a separate property value
> when expressing that very simple condition is sufficient.

We didn't request that. fantasai and I requested to resolve the issue for Mongolian and Phags-Pa, and
joined the discussion. I think HO was their idea to resolve the issue.

I'm fine with HO, or without HO, as long as the issue was resolved. I'm not saying which is better, I'm neutral
on this issue. I'm just saying, if I want a different resolution, I should go to UTC, right?


Regards,
Koji

fantasai | 3 Jul 2012 21:03

Re: [css3-writing-modes] vertical orientation and UTR50

On 07/03/2012 05:10 AM, John Daggett wrote:
>
> Koji Ishii wrote:
>
>>> I don't think there's a need for a separate HO property and have
>>> posted a message in the UTR50 forum stating this. [1]  In fact,
>>> there's no role for HO in defining the behavior of the
>>> 'text-orientation' property since this property only affects
>>> vertical runs, *not* horizontal runs.  So the sentence starting
>>> with "The one exception..." can be omitted entirely.  In vertical
>>> runs, Mongolian and Phags-pa are displayed upright, just as the
>>> MVO/SVO reflects.
>>
>> Well, you know far more on Mongolian than I do, so I'd like to trust
>> you, but other two I also trust -- Laurentiau and fantasai think
>> Mongolian and Phags-pa should be rendered rotated, so I hope you can
>> find a consensus in the forum. I guess it's just difference of
>> visual orientations and rendering orientations, maybe wrong, but
>> it's a UTC's issue.
>
> Koji, are you sure this is what they are thinking?  These are
> *vertical* text runs we're talking about in the context of
> text-orientation.

I'm not sure what the confusion is here, but Mongolian and Phags-pa
rotate between horizontal and vertical orientations. Their rendering
is very complex due to contextual shaping (more so than Arabic) but
is identical in horizontal and vertical modes aside from the 90deg
rotation of the text run.

It is my understanding from talking with Martin Heijdra that this
rotation is expected to be done by the text engine, not by glyph
substitution in the font. Therefore the computation that is actually
used needs to represent the orientation with respect to the horizontal,
not the orientation with respect to the Unicode code charts (which
show the text in vertical mode).

I think your argument is that Mongolian and Phags-pa fonts use vert
substitution, and therefore should be typeset upright. Right? It's
possible, but given how many problems you've pointed out with the
interaction of features in vertical writing, seems unlikely to be
something people would rely on. :) Regardless I would trust Martin
and Microsoft on this matter, since they are the ones with real
experience working with Mongolian. If they say to use vert, then
we'll say to use vert. But since they say to typeset sideways, we
are saying to typeset sideways. And that means we need to account
for HO.

>> HO was resolved on the last UTC conference, it may not survive as
>> you say, but we can remove from our spec if they were removed from
>> UTR#50. We were there too, and supported the resolution, so not
>> using HO looks strange to me. I was ok either if it was an
>> informative text, but if the text is normative, I think we should
>> follow UTC's resolution.
>
> Look at the data, no implementation needs to use that data, they will
> realize immediately that the data reduces to "if the script is
> Mongolian or Phags-pa handle the horizontal case differently".
>
> I'm completely at a loss to understand why you requested a separate
> property value when expressing that very simple condition is
> sufficient.

For the horizontal orientation, we said that either some prose in
the spec or a new property would be fine, as long as it was explicit
enough that the reader had to make no inferences as to which codepoints
were affected. The UTC opted for a property.

~fantasai

Koji Ishii | 30 Jun 2012 10:53
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> > I don't think the last part is true. The spec clearly says "we will be
> > tracking changes."[1]
> 
> You said we resolved to do this to help publishers produce content that does not
> depend on some specific engine, right? And these publishers were happy when we did.

Yes.


> Are they going to be happy when these changes we are tracking invalidate some of
> their content? If they don't care about tomorrow's engines rendering today's content
> differently then I don't understand what problem we're trying to solve by hosting this
> snapshot;

You're right that it's not ideal. There are two issues here; interoperability and longevity. We don't have
either today.

Both are important, but by looking at the reality, they understand HTML/CSS3 is not rock solid yet.
Underlines are drawn on the left so they use borders instead. Text-combine is fragile so they use spans
today, or even images. Most renderers do not support Unicode IVS yet so they use images for some
characters. Because of these issues, they do understand longevity is hard, and they understand that
sometime in near future, they have to upgrade all the contents, once or twice or even more.

But interoperability is a separate issue. Adobe has released its prerelease version with their own
orientations. Amazon and Kobo showed their sneak preview on their sites last week. Many implementers
have provided their evaluation versions with their own orientation too, each of which differ from each
other. Authors had to create one file for each implementation before Hamburg, and they couldn't go with that.

So the solution they need is to resolve interoperability, but it does not necessarily resolve longevity.

> if, on the other hand, these publishers do expect the content they are
> producing today to render the same in future engines that conform to
> css3-writing-modes and UTR50 then I do not understand how making our own copy
> of UTR50 fulfills that expectation. Unless we plan on ignoring those
> UTR50 changes that would break existing content. As the latter would amount of
> forking a Unicode spec and that seems a horrible idea I want to make sure I
> understand why we're doing this. I clearly thought I did at the time; I no longer do.

I guess I found one different view we have here. When we say "future," I guess you're talking about future
after UTR50 goes final, right?

I have no idea when it happens. Maybe in 6 month. Maybe more. I wish it be quick, but I don't want to count on it,
and I expect there will be more implementations before UTR50 goes final. We have different view here,
haven't we?

Let's say one implementer took draft #5 and fixes they wish. A couple of months later, another implementer
took draft #7 with their favorite fixes. Some implementers may ignore UTR50 because it's still a draft.
They will be then not interoperable. I wish someone gives a guideline for what to do before UTR50 goes final.

That someone could be anyone. Not necessarily the CSS WG. But we're the organization of interoperability
of web technologies, and we'll need to give one when UTR50 is final anyway because upper layer must define
interpretations of values, so it's ideal if we can give a temporal guideline earlier.


> > Well, "some" may be true because not everyone reads specs. Could be "many."
> > But as I wrote in my previous mail, we could work on versioning scheme
> > and define how to migrate old contents to new one with some transition
> > period, if the WG agrees with it.
> 
> This is something the WG may do between levels of a spec. We do not and should not
> version between drafts. That is the responsibility of whoever wants to implement
> them.

Ok, it's up to the WG. I wish we had, and I'll probably propose anyway, because orientation is too
fundamental compared to other properties, but I'll follow the WG decision as I always do.

I understand the Web is more about live and not much about longevity. EPUB3, KF8, and other packaging
formats care more about longevity, and they have versioning scheme built-in, so they're fine. I'm
expecting some e-books go the Web too, but Web is probably easier to update contents and easier to ask users
to upgrade their browsers.

Versioning scheme is a nice-to-have for me, I agree that we can update the table without it.


> It explains why we need UTR50 and css3-writing-modes. It does not explain why we
> need a copy of UTR50 into our own draft.

It may come to when we expect UTR50 goes final, and when we expect authors start creating files. For UTR50, I
have no idea, but the next UTC conference is 30th Jul, and I hope you agree that it won't go final by then. The
next UTC is 5th Nov. Maybe or maybe not. The next is 28th Jan, 2013. Maybe, who knows. Remember, when we
started working on UTR50, everyone thought it's 3 months of work. One year has passed and we're still in the
middle of the road.

And the deadline I was given was June, 2012. I hope you understand that there's a clear gap between the two,
and I'm more than happy to hear any proposals to make implementations interoperable during the period.


> > Now, please allow me to ask questions to make sure if I understand you
> > correctly, because this one seems to be especially important, and I
> > can't be confident on my English skills. Sorry for bothering.
> >
> > 1. You may be ok if temporarily -- temporarily do you mean by the
> > final of UTR50, correct?
> 
> 'However temporarily that may be' means no, I'm not OK with keeping a copy of
> UTR50 in our own specs at all. I don't think we should copy/paste other specs or
> modules we depend on into our own.

I agree that we shouldn't. But we're in the conflict of priority.

They are not asking to have a snapshot, they're asking for the interoperability, and we're the world's best
organization that makes the web technologies interoperable.

We have to choose either one of these; make a snapshot, disregard the request for interoperability, or come
up with a new idea.

I hope the WG does not give up the interoperability so easily. I also hope that the WG would not pull the ladder
once promised, after the deadline is over.


> > 2. You may be ok if we don't have to support such an expectation, or
> > if we have explicit agreement from our Unicode partners. Correct?
> 
> I am saying it is up to Unicode to define UTR50 and indicate whether it is stable enough
> for implementation by publishers or anyone else; we should not be the ones saying
> or implying that imo. Note that I'm not sure we are doing so; but that is what I am
> *perceiving* from your explanation i.e. we do this so publishers who want to produce
> e-books today have a one-stop spec to work with. I have a hard time assuming said
> publishers do not also expect future css3-writing-modes drafts - and thus UTR50 if we
> carry that along - to be backward compatible with their content.

I don't disagree with you again. I completely agree with you that this is a hard choice. The problem is, not
snapshotting will end up with un-interoperable chaos and possibly near-future implementations will be
kicked out until UTR50 goes final and everyone finishes migrations. This period could be from 6 months to
years. This is not good, and snapshotting is not good either. Which would we take?

I also agree that your concern is valid that we do not want them to have such expectations. We could do that
whatever we can to minimize that, and remember, it's always the WG to decide, so we can disregard even if
they had such expectations. So while I agree with the concern, I think it's workable.

The problem again is which bad way is a better choice for us.


> > 3. I didn't understand what the "such an expectation" is. Did you mean
> > if we can come up with good wordings to make sure what we have in the
> > draft is temporarily until UTR50 becomes final, final UTR50 is very
> > likely to have different values, and support for the current table
> > will be deprecated in future?
> 
> I am saying css3-writing-modes should not set any expectations about UTR50's
> completeness or stability, or confuse anyone about the dependency of one spec on the
> other by including a copy that may or may not be up to date.

Well, if authors/users expectations are the real problem, couldn't we reduce the risk by adding more wordings?


> > 4. Does "explicit agreement from our Unicode partners" mean we get
> > explicit agreement from Eric, the editor of the UTR50, to have a
> > snapshot in our spec?
> 
> Er, you mean you haven't asked? Yeah, assuming there ever is a good reason to
> snapshot some other standard body's spec into our own I think we should ask...

I told them. But I also understand it's probably hard to make an official answer, so I didn't ask them to
answer. Remember two years ago when EPUB guys came in, we didn't answer. We said this and that, I remember
someone said they should take a copy of the CSS specs, and didn't tell them the WG conclusion. It looks very
logical and reasonable to me. If EPUB needs something we can't provide, they should take the risks by
themselves. Now that several technologies using CSS are asking us for the interoperability of CSS. We
publicly said we'll help them. I'll follow to whatever the WG decides, but I think this is a very critical
decision for the WG.


> > 5. Assuming 3 and 4 are correct, allow me to double-confirm; are they
> > OR? I mean, you can live with either, or do you require both?
> 
> I am trying to understand why we want to have a snapshot of UTR50 in a CSSWG draft.
> I do not understand the need or benefits. I do see plenty of potential downside.

Ok, I completely agree with you that it has potential downsides. Is this mail good to explain benefits, and
downsides of not doing so?


Regards,
Koji

Kang-Hao (Kenny) Lu | 1 Jul 2012 03:53
Picon
Picon
Favicon

Re: [css3-writing-modes] vertical orientation and UTR50

Just drop in some personal feeling here.

(12/06/30 16:53), Koji Ishii wrote:
> It may come to when we expect UTR50 goes final, and when we expect
> authors start creating files. For UTR50, I have no idea, but the next
> UTC conference is 30th Jul, and I hope you agree that it won't go
> final by then. The next UTC is 5th Nov. Maybe or maybe not. The next
> is 28th Jan, 2013. Maybe, who knows. Remember, when we started
> working on UTR50, everyone thought it's 3 months of work. One year
> has passed and we're still in the middle of the road.
>
> [snip]
>
> They are not asking to have a snapshot, they're asking for the
> interoperability, and we're the world's best organization that makes
> the web technologies interoperable.

These make sense to me. My guess is that the W3C vs. Unicode Consortium
situation here is just similar to WHATWG vs. W3C. Having a bit of
personal experience with Unicode Consortium, my sense is that Koji is
right here, and the snapshot version might actually be closer to UTR#50
final than the current draft is.

I think it is certainly better to have a snapshot version placed
somewhere in w3.org and referenced by css3-writing-modes than Koji
hosting his own in his domain (and perhaps forking css3-writing-modes too).

Cheers,
Kenny

Glenn Adams | 1 Jul 2012 06:03
Gravatar

Re: [css3-writing-modes] vertical orientation and UTR50

On Sat, Jun 30, 2012 at 7:53 PM, Kang-Hao (Kenny) Lu <kennyluck <at> csail.mit.edu> wrote:
Just drop in some personal feeling here.

(12/06/30 16:53), Koji Ishii wrote:
> It may come to when we expect UTR50 goes final, and when we expect
> authors start creating files. For UTR50, I have no idea, but the next
> UTC conference is 30th Jul, and I hope you agree that it won't go
> final by then. The next UTC is 5th Nov. Maybe or maybe not. The next
> is 28th Jan, 2013. Maybe, who knows. Remember, when we started
> working on UTR50, everyone thought it's 3 months of work. One year
> has passed and we're still in the middle of the road.
>
> [snip]
>
> They are not asking to have a snapshot, they're asking for the
> interoperability, and we're the world's best organization that makes
> the web technologies interoperable.

These make sense to me. My guess is that the W3C vs. Unicode Consortium
situation here is just similar to WHATWG vs. W3C. Having a bit of
personal experience with Unicode Consortium, my sense is that Koji is
right here, and the snapshot version might actually be closer to UTR#50
final than the current draft is.

Since your opinion is based on sheer speculation that the final UTR#50 will be close to or identical to a snapshot, then i'm afraid I do not give much weight to that opinion.

It is unacceptable for the W3C to create a snapshot copy of another external spec in this fashion for the mere reason of being dissatisfied with the progress or schedule for finalizing that external spec. That's just not how things are done in the W3C, nor should it ever be.

The correct approach is to reference UTR 50 and work with the UTC to finalize UTR 50 in a timely fashion. WM still has to get to CR exit criteria, so it is premature to even suggest such an approach as creating a UTR50 snapshot.
 

I think it is certainly better to have a snapshot version placed
somewhere in w3.org and referenced by css3-writing-modes than Koji
hosting his own in his domain (and perhaps forking css3-writing-modes too).


Cheers,
Kenny




fantasai | 2 Jul 2012 02:27

Re: [css3-writing-modes] vertical orientation and UTR50

On 06/30/2012 09:03 PM, Glenn Adams wrote:
>
> Since your opinion is based on sheer speculation that the final UTR#50 will be close to or identical to a
snapshot, then i'm
> afraid I do not give much weight to that opinion.

It's not sheer speculation, most of the differences here were
already agreed to in discussions at Unicode, and we are involved
in the process of making those decisions.

> The correct approach is to reference UTR 50 and work with the UTC to finalize UTR 50 in a timely fashion.

We're doing that already. But "timely" is not going to happen here,
if the considerations Koji has outlined are to be satisfied.

> WM still has to get to CR exit criteria

This is irrelevant.

~fantasai

Glenn Adams | 2 Jul 2012 02:34
Gravatar

Re: [css3-writing-modes] vertical orientation and UTR50

On Sun, Jul 1, 2012 at 6:27 PM, fantasai <fantasai.lists <at> inkedblade.net> wrote:

On 06/30/2012 09:03 PM, Glenn Adams wrote:
WM still has to get to CR exit criteria

This is irrelevant.

It is relevant. If it takes N months/years to get to CR exit, then it gives UTR50 that long to reach conclusion. WM can reference UTR50. The arguments for a snapshot are inordinately weak and contrary to W3C specification conventions. 
Sylvain Galineau | 1 Jul 2012 22:28
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50


[Kang-Hao (Kenny) Lu:] 
es interoperable.
> 
> These make sense to me. My guess is that the W3C vs. Unicode Consortium
> situation here is just similar to WHATWG vs. W3C. 

Given the interesting challenges involved in having two HTML specs I'm not 
sure you're reassuring anyone here :) I would argue any such similarity means
we should know why we *need* to put ourselves in this kind of situation.

> Having a bit of personal
> experience with Unicode Consortium, my sense is that Koji is right here,
> and the snapshot version might actually be closer to UTR#50 final than the
> current draft is.
> 
> I think it is certainly better to have a snapshot version placed somewhere
> in w3.org and referenced by css3-writing-modes than Koji hosting his own
> in his domain (and perhaps forking css3-writing-modes too).
> 
I strongly disagree. It is most certainly not 'better' for w3.org to snapshot 
another standard body's work in one of its draft. This is something that we must 
avoid unless there is a clearly established need to do so, with approval from the 
group whose work is being snapshotted. To the extent that 1) this file can be 
directly derived from Unicode's data and 2) we effectively already specify how 
it can be produced in a note then I do not think we need to snapshot anything. 
Making this note normative is sufficient and eliminates any risk of confusion or
misplaced expectations. 


Koji Ishii | 29 Jun 2012 22:26
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> > Can I ask then what authors should do today? The question we were
> > given at Hamburg was, do we want them to create tens of thousands of
> > HTML/CSS files based on WebKit's implementation, or do we want to publish our own
> > table.
> 
> I don't understand this argument at all. Because some early adopters have no qualms
> about taking a hard WebKit dependency we should align with this implementation even
> though it already diverges from where Unicode is going ?

No, they asked us because they do have qualms and hoped us to give a solution. And we once gave them in May.


> You can't spec early adopters out of doing anything. Your job as editor is to specify
> a solution for everyone else. Forking our own bits of Unicode to placate some early
> adopters is absolutely not an option imo.
> Publishers are free to take any dependency on WebKit they like; but they simply
> cannot count on Unicode or W3C pre-emptively declaring that choice to be
> conformant.

My job as an editor is to specify a solution the WG agreed and resolved, and I'm doing exactly what I should do,
don't I?

Adobe has released the preview version of their software using their own orientations. A few more vendors
were in the queue using their own orientations, by fixing what they believe is correct over the WebKit.

Publishers and authors are really in trouble and asked us for a help. They never counted on us.

They asked for a help, and we resolved to help them.


> Now, were we to reach a point where multiple browser implementations converged
> and handled the same content in a compatible manner *AND* UTR50 diverged from
> them then you'd have a somewhat reasonable rationale for *considering* something
> like this as an interim spec fix. But even then, what would it solve? We *cannot* fork
> Unicode.

We could then deprecate the table and add another value for the final version of UTR50. We could add versions
to the syntax. There are many ways to lead gradual move to the final UTR50. Implementers may have to
maintain a few tables for a period of time, but it's far better than each implementer having different tables.


> And when it comes to Unicode, content is not just web pages. Having browsers
> process Unicode vertical orientation one way while other Unicode processing software
> - e.g. operating system libraries, word processors, formats such as PDF - does it
> differently is too painful to contemplate.

UTR50 is a foundation. How to interpret, say, Tu or Tr is up to upper layers. Because we have resolved that
orientations in CSS should not depends on fonts, it's quite likely that the interpretation will be
different from word processors. If they took the same way as CSS, it will bring them back to Word 2.0 level of
multi-lingual capability. The goal of UTR50 is still fragile as John pointed out; some people believes it
should be designed for plain text as the first priority. If we go that way, again, word processors will not
be able to take it. PDF has different orientation mechanism already standardized as ISO.

Consider GDI. It has a default orientation table. UTR50 is a good improvement over it. But no professional
software use just GDI to render vertical flow today, because doing so produces only similar results as
notepad. The goal of UTR50 is not about to change the situation, but have a common default orientation
across platforms and increase the coverage to global.


> > I assume you're not recommending WebKit given recent discussion on mobile
> > web.
> 
> This is a standard WG. Our job is not to recommend WebKit, Trident, Presto or
> Gecko; our job is to recommend what all these and others should do for the
> web, not just the 'mobile' web.

I'm sorry, I don't understand this. Maybe my wordings were not appropriate, sorry about that. What I wanted
to say was, if we tell authors to do UA dependent and let the market to decide, we will have a risk to see what we
see today for webkit-text-size-adjust.

I completely agree with you on the job of a standard WG. Users, authors, and implementers are asking for a
recommendation to us. What would we recommend?


> > I also assume you don't like UA dependent, which I originally
> > proposed. I can't see what your answer is.
> 
> Early implementations will almost always have UA-dependent behavior,
> and early adopters will come to depend on some of these. Our job is to
> minimize - if not eliminate - UA dependencies from future content and
> implementations. Diverging from another standard body's ongoing work
> due to a single early implementation is not a good way to achieve that.

As I said above, it's not single implementation already. And we're not diverging, snapshotting with
possible versioning strategy is very different from diverging.

I agree that it's not the ideal way, but if you have any other ways to help authors and implementers, I'd
really love to hear. Asking them to wait doesn't help, and I'm pretty sure that it will hit us back.


> > If I understand correctly, our ultimate goal is to maximize the
> > interoperability of the Web technologies, so that authors can trust us. So
> > that later implementations can enjoy existing contents. So that users have
> > maximum freedom to choose their favorite browsers to view contents.
> 
> What existing content are we talking about? 'What a lot of content would look
> like if it conforms to the last WebKit nightly' does not qualify as 'existing
> content'. If some ebook publishers want to depend on WebKit's implementation,
> they're welcome to. If that turns out to be incompatible in the future then
> they'll need to deal with the legacy they chose to create. Such is life.

No, you misunderstood. They do NOT want to depend on WebKit, and that's why they asked me to raise this issue
at Hamburg. If we can't help them, at that point, they may had to depend on WebKit.

They asked us for a help how they can make their contents to qualify as 'existing content,' and we promised to
help. Now are we trying to pull the ladder?


> > I don't think the resolution does anything wrong to the goal.
> >
> If the DWrite team builds UTR50 support and I can't also conform to your draft
> without special-casing their work I'll have to disagree and formally object.

I don't know when and what the DWrite team is going to build. If UTR50 is final by the time the DWrite team is
going to start writing code, we will have a version scheme to distinguish the final. You could support only
final, or support deprecated value as well, it's up to you.

And it's never been my draft, it's our draft. I've never wrote single word that the WG do not agree.


> So. If you think WebKit's current support should be the standard then you need to
> convince the folks who write UTR50 to agree. Pretending they already have by
> maintaining your own copy is not the way to go.

I'm sorry if my previous mail was misleading, but I've never said WebKit should be the standard. Ah...and
I'm sorry again but I didn't understand the last sentence. We told Eric and Laurentiu that we're going to
snapshot, they didn't respond, which is understandable, because I guess we will say so to other groups if
we were in the same situation.


Regards,
Koji

Florian Rivoal | 2 Jul 2012 10:24
Picon
Favicon

Re: [css3-writing-modes] vertical orientation and UTR50

On Fri, 29 Jun 2012 20:50:46 +0200, Sylvain Galineau
<sylvaing <at> microsoft.com> wrote:

>
> [Koji Ishii:]
>>
>> Can I ask then what authors should do today? The question we were given  
>> at
>> Hamburg was, do we want them to create tens of thousands of HTML/CSS  
>> files
>> based on WebKit's implementation, or do we want to publish our own  
>> table.
>
> I don't understand this argument at all. Because some early adopters
> have no qualms about taking a hard WebKit dependency we should align with
> this implementation even though it already diverges from where Unicode
> is going ?

The proposal is not to align with Webkit's implementation. My
understanding is that Webkit's current behavior is considered horrendous,
and speccing in an approximation of what UTR50 will become is an attempt
at steering them away from madness.

By getting them to something relatively close to what the final version of
UTF50 will be, there will not be too much breakage when we switch to the
final version, unlike what would happen if we let them use a completely
different beast.

I kind of agree with the idea, but it seems to be that what needs
to target a snapshot of UTR50 is the webkit implementation much
more than the spec. If putting it in the spec would help webkit
get there, then I am in favor of doing that.

On the other hand, I am not entirely sure why it helps. If the
webkit implementors don't care, and then it doesn't matter what
we do. If they do care about matching what we plan to do, a
resolution saying "we will use UTR50 when ready, until then
implementations are encouraged do try and stay close to the
behavior advocated in UTR50's current drafts" should be enough.

Or do we expect that authors will code to the spec, and complain
about webkit working differently, forcing it to change, rather than
code to the currently available behavior?

> If some ebook publishers want to depend on WebKit's implementation,
> they're welcome to. If that turns out to be incompatible in the future  
> then
> they'll need to deal with the legacy they chose to create. Such is life.

The demand for vertical text seems stronger in ebooks than in the general
web, so the risk is that if we don't act early to guide the early ebooks
implementation towards a behavior we consider sane, they may depend on
an unspecified vendor specific behavior in the long run because they
started with that, putting pressure on that vendor not to change its
behavior, and on others to reverse engineer it.

  - Florian

Koji Ishii | 2 Jul 2012 17:59
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> From: Florian Rivoal [mailto:florianr <at> opera.com]
> I kind of agree with the idea, but it seems to be that what needs to target a snapshot
> of UTR50 is the webkit implementation much more than the spec. If putting it in the
> spec would help webkit get there, then I am in favor of doing that.

You're right. That was exactly what we wanted at Hamburg.

> On the other hand, I am not entirely sure why it helps. If the webkit implementors
> don't care, and then it doesn't matter what we do. If they do care about matching
> what we plan to do, a resolution saying "we will use UTR50 when ready, until then
> implementations are encouraged do try and stay close to the behavior advocated in
> UTR50's current drafts" should be enough.
> 
> Or do we expect that authors will code to the spec, and complain about webkit working
> differently, forcing it to change, rather than code to the currently available behavior?

And the resolution at Hamburg actually helped, although it may not make WD now. By that resolution, authors
understood something more stable and usable is coming soon. Implementers understood it's something
worth to spend time on. Access, a Japanese implementer, actually created a patch and is going to upstream
to Readium, and is also seeking for a possibility to upstream WebKit too. I'm not sure if they can make it or
not, but yes, that was what I wanted, and the resolution at CSS WG helped it to happen.

> The demand for vertical text seems stronger in ebooks than in the general web, so
> the risk is that if we don't act early to guide the early ebooks implementation towards
> a behavior we consider sane, they may depend on an unspecified vendor specific
> behavior in the long run because they started with that, putting pressure on that
> vendor not to change its behavior, and on others to reverse engineer it.

It was exactly where Japanese authors and implementers were before Hamburg. Thank you for explaining that
in clean words.

Now that both authors and implementers are aligned to draft #5.5 thanks to the resolution and thanks to a lot
of work to make it, and draft #6 is in the horizon, Sylvain's proposal makes great sense to me now.


Regards,
Koji

John Daggett | 3 Jul 2012 05:24

Re: [css3-writing-modes] vertical orientation and UTR50

Koji Ishii wrote:

> > On the other hand, I am not entirely sure why it helps. If the
> > webkit implementors don't care, and then it doesn't matter what we
> > do. If they do care about matching what we plan to do, a
> > resolution saying "we will use UTR50 when ready, until then
> > implementations are encouraged do try and stay close to the
> > behavior advocated in UTR50's current drafts" should be enough.
> >
> > Or do we expect that authors will code to the spec, and complain
> > about webkit working differently, forcing it to change, rather
> > than code to the currently available behavior?
> 
> And the resolution at Hamburg actually helped, although it may not
> make WD now. By that resolution, authors understood something more
> stable and usable is coming soon. Implementers understood it's
> something worth to spend time on. Access, a Japanese implementer,
> actually created a patch and is going to upstream to Readium, and is
> also seeking for a possibility to upstream WebKit too. I'm not sure
> if they can make it or not, but yes, that was what I wanted, and the
> resolution at CSS WG helped it to happen.

This issue actually has very little bearing on the problems with the
Webkit implementation which are much more fundamental than simply
which codepoints are oriented which way by default.  There are a
number of basic problems with the current Webkit implementation, ones
that I've reported [1] and which you, Koji, have commented on.  Not
centering upright Latin is a fairly fundamental problem.

Nor do authors *require* a solution to the question of proper
defaults, since they can always use the values of 'upright' and
'sideways' to manually specify the orientation they prefer.

John Daggett

John Daggett | 3 Jul 2012 05:25

Re: [css3-writing-modes] vertical orientation and UTR50


> This issue actually has very little bearing on the problems with the
> Webkit implementation which are much more fundamental than simply
> which codepoints are oriented which way by default.  There are a
> number of basic problems with the current Webkit implementation,
> ones that I've reported [1] and which you, Koji, have commented on. 
> Not centering upright Latin is a fairly fundamental problem.

Argh, forgot to attach the link:

[1] https://bugs.webkit.org/show_bug.cgi?id=86071

Koji Ishii | 3 Jul 2012 13:31
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> From: John Daggett [mailto:jdaggett <at> mozilla.com]
> This issue actually has very little bearing on the problems with the Webkit
> implementation which are much more fundamental than simply which codepoints are
> oriented which way by default.  There are a number of basic problems with the
> current Webkit implementation, ones that I've reported [1] and which you, Koji, have
> commented on.  Not centering upright Latin is a fairly fundamental problem.
> 
> Nor do authors *require* a solution to the question of proper defaults, since they can
> always use the values of 'upright' and 'sideways' to manually specify the orientation
> they prefer.
> 
> [1] https://bugs.webkit.org/show_bug.cgi?id=86071


I'm sorry, I understand these WebKit's bugs, but I do not understand the relationship of the topic and the
bugs. Can you tell me what I'm missing?

#2 is a bug in Mac port, or more likely a bug in Core Text. Japanese implementers do not see the bug in their ports.

#4 and #5 only appears when WebKit use the complex code path, and if the port doesn't support vertical flow in
the complex code path. The priority of the code path isn't high that I don't know if coming ports have the bug
or not. I had some conversation with Chromium guys how to fix this issue, but nobody has time to work on it
right now.

But this isn't a CSS issue, is this?


Regards,
Koji

John Daggett | 3 Jul 2012 13:53

Re: [css3-writing-modes] vertical orientation and UTR50


Koji Ishii wrote:

> I'm sorry, I understand these WebKit's bugs, but I do not understand
> the relationship of the topic and the bugs. Can you tell me what I'm
> missing?
> 
> #2 is a bug in Mac port, or more likely a bug in Core Text. Japanese
> #implementers do not see the bug in their ports.
> 
> #4 and #5 only appears when WebKit use the complex code path, and if
> #the port doesn't support vertical flow in the complex code path.
> #The priority of the code path isn't high that I don't know if
> #coming ports have the bug or not. I had some conversation with
> #Chromium guys how to fix this issue, but nobody has time to work on
> #it right now.
> 
> But this isn't a CSS issue, is this?

No, it's not, but your claim was that snapshotting would influence
Webkit's behavior.  My point is that there will be many things that
will eventually change in that implementation as the bugs and problems
are flushed out.  Not having UTR50 finished yet is the least of their
worries.

John Daggett

Koji Ishii | 3 Jul 2012 14:15
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> No, it's not, but your claim was that snapshotting would influence Webkit's behavior.
> My point is that there will be many things that will eventually change in that
> implementation as the bugs and problems are flushed out.  Not having UTR50 finished
> yet is the least of their worries.

I see your point now, thank you. Well, the difference is that, not many in Japan believed in UTR#50 because
its quality doesn't come to good enough after one year of the work, so Japanese authors and implementers
working on WebKit-based products needed a proof of UTR#50 is going to a good shape.

I know WebKit has a lot of more bugs in its vertical flow implementation, but those are issues they can work
on. They actually fixed many issues and is going to upstream to Readium. Glyph orientation is an issue they
can't work on, so UTC needed to fix critical issues, and we needed to show the direction.


Regards,
Koji

Florian Rivoal | 3 Jul 2012 10:02
Picon
Favicon

Re: [css3-writing-modes] vertical orientation and UTR50

On Mon, 02 Jul 2012 17:59:17 +0200, Koji Ishii <kojiishi <at> gluesoft.co.jp>  
wrote:

> And the resolution at Hamburg actually helped, although it may not make  
> WD now. By that resolution, authors understood something more stable and  
> usable is coming soon. Implementers understood it's something worth to  
> spend time on. Access, a Japanese implementer, actually created a patch  
> and is going to upstream to Readium, and is also seeking for a  
> possibility to upstream WebKit too. I'm not sure if they can make it or  
> not, but yes, that was what I wanted, and the resolution at CSS WG  
> helped it to happen.

So what we needed was a clear and visible statement that UTR50 was the  
answer.
We made it, and that triggered the relevant changes in the early
implementations. Good.

> Now that both authors and implementers are aligned to draft #5.5 thanks  
> to the resolution and thanks to a lot of work to make it, and draft #6  
> is in the horizon, Sylvain's proposal makes great sense to me now.

I think this should be acceptable to everybody, yes.

  - Florian

Koji Ishii | 29 Jun 2012 19:15
Picon
Favicon

RE: [css3-writing-modes] vertical orientation and UTR50

> > I think with the last sentence and a discussion of Mongolian/Phags-pa
> > in UTR50 is sufficient for interoperability, I don't see the need for
> > a verbose explanation of SVO handling for these scripts.
> 
> Ok, I will change the code to the text late tonight. It was too complex for me to write
> in English, your proposed wordings really helps me. Thank you about that.

Done, I had to make some edits as the text wasn't based on the derived properties. Your double check is appreciated.


Regards,
Koji

John Daggett | 1 Jul 2012 08:58

Re: [css3-writing-modes] vertical orientation and UTR50


Koji Ishii wrote:

> > Then we should request another UTR50 draft containing the changes
> > and use that.  I am very strongly against defining something that
> > looks like a delta on top of the UTR50 proposal.  There is
> > absolutely no reason to rush to publish something based on
> > preliminary edits that have not necessarily converged to their final
> > form.
> 
> First, we resolved to put our own table in the writing-modes spec[1]:
> 
> > - RESOLVED: put our own table of behaviors for mixed-right and upright
> >               values in the writing-modes spec until UTR50 stabilizes

This is an unfortunate paraphrase of what was said.  Elika asked if we
could make a copy of the UTR data and I said yes.  There was some
nodding and that was about it.

My feeling now is that there's some pushback from folks in Japan so I
think it would be best to define the property values 'mixed-right' and
'upright' clearly and simply based on the Unicode properties defined
in UTR50.  Once those are resolved, we will have a clear normative
definition without the need to change/tweak it later because we
snapshotted the data too soon.

John Daggett


Gmane