Francesca Ciceri | 2 Apr 2012 16:11
Picon
Favicon

Debian Project News - April 2nd, 2012

------------------------------------------------------------------------
The Debian Project                                http://www.debian.org/
Debian Project News                    debian-publicity <at> lists.debian.org
April 2nd, 2012               http://www.debian.org/News/weekly/2012/07/
------------------------------------------------------------------------

Welcome to this year's seventh issue of DPN, the newsletter for the Debian
community. Topics covered in this issue include:

  * Bits from Debian Med team
  * Debian joins the OSI
  * Report from DSA Team sprint
  * "Fascinating": a Debian based tricorder
  * So long, and thanks for all the news
  * Interviews
  * Other news
  * New Debian Contributors
  * Release-Critical bugs statistics for the upcoming release
  * Important Debian Security Advisories
  * New and noteworthy packages
  * Work-needing packages
  * Want to continue reading DPN?

Bits from Debian Med team
-------------------------

Andreas Tille sent some bits from the Debian Med team [1], where he
talked about recent initiatives of the team including the [2] "Debian Med
Bug Squashing Advent Calendar 2011" and the [3] "Mentoring of the Month"
(MoM) project. Andreas also reminded us that in January the Debian Med
(Continue reading)

Andrei POPESCU | 2 Apr 2012 22:48
Picon

Possible bug when generating mail version [was: Re: Debian Project News - April 2nd, 2012]

Hi -publicity,

> Bits from Debian Med team
> -------------------------
...
> specialised packages with a high quality standard", as Andreas said in
> arelated blogpost [4]. The Debian Med project not only provides and
^^^^^

...
> Debian rules in a team with common interest", added Andreas in the mail.
> This idea was confirmed by the results of asurvey focused on why Debian
                                           ^^^

> Med team members became Debian Developers [5].
...
> Report from DSA Team sprint
> ---------------------------
...
> to support the whole set of architectures for which Debian is shipped. For more
> information on how to donate equipment to the Debian Project, please contact
> thehardware donations team [8].
^^^^^^^^^

As you can see, in the mail version there are three missing spaces in 
places where the wml version in svn has URLs. I suspect there is a bug 
in the script/utility used to generate the text version.

Kind regards,
Andrei
(Continue reading)

David Prévot | 2 Apr 2012 23:00
Picon
Favicon

Re: Possible bug when generating mail version

Hi,

Le 02/04/2012 16:48, Andrei POPESCU a écrit :

> P.S I have seen occurrences in the past but not for a while, maybe this 
> information is useful...

It's actually a known issue, and we manually fix those errors before
sending the mail (but obviously, we sometime miss some). Patches against
the current script (or another way to prepare those mails) would be
highly welcome.

http://anonscm.debian.org/viewvc/publicity/dpn/scripts/DPNhtml2mail.pl?view=co

Regards

David

Andrei POPESCU | 3 Apr 2012 22:48
Picon

Re: Possible bug when generating mail version

On Lu, 02 apr 12, 17:00:55, David Prévot wrote:
> Hi,
> 
> Le 02/04/2012 16:48, Andrei POPESCU a écrit :
> 
> > P.S I have seen occurrences in the past but not for a while, maybe this 
> > information is useful...
> 
> It's actually a known issue, and we manually fix those errors before
> sending the mail (but obviously, we sometime miss some).

Well, a spell checker would help too.

> Patches against
> the current script (or another way to prepare those mails) would be
> highly welcome.

Unfortunately I don't speak perl, but I'll see what I can do with 
already existing tools.

Kind regards,
Andrei
--

-- 
Offtopic discussions among Debian users and developers:
http://lists.alioth.debian.org/mailman/listinfo/d-community-offtopic
Thomas Blein | 3 May 2012 00:14
Picon
Favicon

New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear all,

I got a look in the DPNhtml2mail.pl script to improve it and more
particularly solved the problem Andrei report.

I work around and change quite a lot of things inside it to correct also
some small bugs in the display (extra spacing mainly) with some hacks
dedicated to the French version.

I tested it on the DWN 2012/07 and it looks like the layout is nice for
French and English. I did not tested so much with the other languages.

The script is not perfect since I am new to perl and some factorisation
of the code might be useful.

Do not hesitate to report any problem.

Best regards,

Thomas
Attachment (DPNhtml2mail.pl): text/x-perl, 11 KiB
David Prévot | 3 May 2012 01:43
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi,

Le 02/05/2012 18:14, Thomas Blein a écrit :

> I got a look in the DPNhtml2mail.pl script to improve it and more
> particularly solved the problem Andrei report.

Thanks Thomas!

> DPNhtml2mail.pl
[…]
> # Correction of indentation of the script

Do you have a version without that change? Or at worst, a way to apply
the same changes to the current version: it's pretty hard to figure out
what is the actual code edited.

Regards

David

Thomas Blein | 3 May 2012 03:26
Picon

Re: New version of DPNhtml2mail.pl


Hi,

Le 03/05/12 01:43, David Prévot a écrit :
> Le 02/05/2012 18:14, Thomas Blein a écrit :
>> # Correction of indentation of the script
> 
> Do you have a version without that change? Or at worst, a way to 
> apply the same changes to the current version: it's pretty hard to
>  figure out what is the actual code edited.

I managed to revert all the indentation correction. Still a lot of
changes but maybe clearer for the diff.
I did this correction of the indentation mainly because it was
difficult for me to follow the code.

Regards,

Thomas
Attachment (DPNhtml2mail.pl): text/x-perl-script, 8 KiB
Thomas Blein | 4 May 2012 01:04
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi everybody,

after some discussion with David and Cédric on IRC, here is a new version
of DPNhtml2mail.pl

I know there are some error when processing some languages:
"Wide character in print at ./DPNhtml2mail.pl line 243"

I will check it certainly not before beginning of next week.

Feedbacks are welcome,

Regards,

Thomas
Attachment (DPNhtml2mail.pl): text/x-perl, 9 KiB
David Prévot | 4 May 2012 04:34
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi,

Le 03/05/2012 19:04, Thomas Blein a écrit :

> here is a new version of DPNhtml2mail.pl

That's great, thanks a lot! Those improvements will make our life a lot
easier, so I just committed it (r3684, only removing “# Correction of
indentation of the script” from the changelog, thanks for that too: it
helps to figure out what the actual changes are).

> Feedbacks are welcome,

There are so many better things, I can't count them all, so I'll just
focus on some remaining bits. While testing on the last French DPN issue
(2012/09), we can still spot some bugs:

- incorrect handling of some links (e.g. “unautre” l.72 or “donnéun”
	l.88);
- missing newline after a list (e.g. events l.158 or only one newline
	after the NNWP, l.282);
- incorrect handling of <acronym> inside <a> (e.g. “[35]UDD” l.198);
- incorrect handling of <q> inside <a> (e.g. NNWP nqp, l.264);

Other ideas, feature request (we already talk of some on IRC, all may
not be easy, but writing them down to remember):

- when a list (<ul>) follows a paragraph (<p>), push URLs from the
	paragraph after the list (e.g. [53] l.255 should be with [54]
	and friends l.272). It's already working fine, when a <p>
(Continue reading)

Thomas Blein | 4 May 2012 15:08
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Le jeudi 03 mai 2012 à 22:34:11 (-0400), David Prévot a écrit :
> Hi,
> 
> Le 03/05/2012 19:04, Thomas Blein a écrit :
> 
> That's great, thanks a lot! Those improvements will make our life a lot
> easier, so I just committed it (r3684, only removing “# Correction of
> indentation of the script” from the changelog, thanks for that too: it
> helps to figure out what the actual changes are).

Can I make a indentation cleaning (my python side…) and record only this
nothing more, or is it forbidden because you prefer to be able to
monitor change on the long way?

> There are so many better things, I can't count them all, so I'll just
> focus on some remaining bits. While testing on the last French DPN issue
> (2012/09), we can still spot some bugs:

[…]

> Other ideas, feature request (we already talk of some on IRC, all may
> not be easy, but writing them down to remember):

They do not look so difficult and might be easy to fix already got some
ideas.

> Since you already have write access, you shouldn't hesitate to commit
> your further improvements directly

I was not confident enough to do so. There will be some "noice" next
(Continue reading)

David Prévot | 10 May 2012 23:20
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi,

Le 04/05/2012 09:08, Thomas Blein a écrit :

> I was not confident enough to do so. There will be some "noise" next
> week!

It looked like very productive noise, thanks a lot Thomas! I can only
think to one last nip-tick: could you drop the last two links (last four
in the French version): those are just email addresses already written
in the text, so we use to remove them anyway.

Regards

David

Thomas Blein | 11 May 2012 10:44
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi,

Le jeudi 10 mai 2012 à 17:20:07 (-0400), David Prévot a écrit :
> I can only
> think to one last nip-tick: could you drop the last two links (last four
> in the French version): those are just email addresses already written
> in the text, so we use to remove them anyway.

I have no idea how to remove them properly, without removing all the
mailto links.
- One possibility is to remove the link if the email address is already
  display in the text, however it will not remove the last link for the
  English version or the two last of the French
- A second one is to remove all the mailto corresponding to a list
  (publicity and l10n). But it will also remove the mailto inside the
  text that correspond.

Let me know which solution you prefer (the both can be implemented
together) or if you have an other idea to identify it. I don't think I
will be able to modify anything before Monday evening, so I would say
that for the next DPN you will still have to remove them manually.

Regards,

Thomas

--

-- 
To UNSUBSCRIBE, email to debian-publicity-request <at> lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster <at> lists.debian.org
Archive: http://lists.debian.org/20120511084417.GA3982 <at> tblein.eu
(Continue reading)

David Prévot | 11 May 2012 17:21
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi,

Le 11/05/2012 04:44, Thomas Blein a écrit :
> Le jeudi 10 mai 2012 à 17:20:07 (-0400), David Prévot a écrit :
>> I can only
>> think to one last nip-tick: could you drop the last two links (last four
>> in the French version): those are just email addresses already written
>> in the text, so we use to remove them anyway.
> 
> I have no idea how to remove them properly, without removing all the
> mailto links.

That would not be a good option, e.g. we usually link “Debian Events
Team” to events <at> debian.org, and we should be able to continue using this
kind of links.

> - One possibility is to remove the link if the email address is already
>   display in the text,

That's a good idea: it's the reason why we remove them, they're already
in the running text.

>   however it will not remove the last link for the
>   English version or the two last of the French

Maybe could it be possible to recognize only the last paragraph (it's
always the same, title has the “continuedpn” anchor, it's before <hr>)
and don't handle any link in it?

The reason why we remove those links, is because they are the same as
(Continue reading)

Thomas Blein | 14 May 2012 21:17
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi,

Le vendredi 11 mai 2012 à 11:21:05 (-0400), David Prévot a écrit :
> > - One possibility is to remove the link if the email address is already
> >   display in the text,
> 
> That's a good idea: it's the reason why we remove them, they're already
> in the running text.

I will work on this.

> 
> >   however it will not remove the last link for the
> >   English version or the two last of the French
> 
> Maybe could it be possible to recognize only the last paragraph (it's
> always the same, title has the “continuedpn” anchor, it's before <hr>)
> and don't handle any link in it?

If the anchor is stable, it will be really easy to not include link
there. Thanks for the 

> > - A second one is to remove all the mailto corresponding to a list
> >   (publicity and l10n). But it will also remove the mailto inside the
> >   text that correspond.
> 
> I'm not sure to understand this last proposal.

We just define a black list of mail that we never display my proposition
is the publicity and all l10n mail addresses.
(Continue reading)

Francesca Ciceri | 14 May 2012 16:39
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi Thomas, 

On Fri, May 04, 2012 at 03:08:49PM +0200, Thomas Blein wrote:
> I was not confident enough to do so. There will be some "noice" next
> week!

I just used your script to send the mail of newest DPN issue: you did an
amazing work!  I mean: I haven't had to change *anything* manually (while
in the past I had to check lots of things).

Thank you very much: you definitely made my job easier :D

Just one thing: can you please add the copyright notice and the license
to the script? It would be great to have it properly licensed, as we're
trying to add a DFSG-free license to all the files on the repo.

Thanks again, 

Francesca

ps: many thanks also to David who helped you in betatesting it
--

-- 
"Nostra patria è il mondo intero
e nostra legge è la libertà
ed un pensiero
ribelle in cor ci sta."		P.Gori
Thomas Blein | 14 May 2012 21:24
Picon
Favicon

Re: New version of DPNhtml2mail.pl

Hi Francesca,

Le lundi 14 mai 2012 à 16:39:44 (+0200), Francesca Ciceri a écrit :
> Thank you very much: you definitely made my job easier :D

This is nice to hear that everything is running as expected!

> Just one thing: can you please add the copyright notice and the license
> to the script? It would be great to have it properly licensed, as we're
> trying to add a DFSG-free license to all the files on the repo.

No problem for me. However I am not the first author of this script:
Jean-Edouard Babin made the first version until 2009 according to the
logs. So concerning the license I do not know what I can do.

Regards,

Thomas

--

-- 
To UNSUBSCRIBE, email to debian-publicity-request <at> lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster <at> lists.debian.org
Archive: http://lists.debian.org/20120514192449.GB5237 <at> yopbook.tblein.eu

AYANOKOUZI, Ryuunosuke | 15 May 2012 12:21
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear all,

Here is an another type of bug on DPNhtml2mail.pl when generating a
Japanese version of DPN. This comes out because of ad-hoc handling
of UTF-8 flagged data. I have attached a debugged DPNhtml2mail.pl to
this mail. please check it.

The following is a complete output of abnormally terminated case.

$ perl ./DPNhtml2mail.pl -i 2012/09 -l ja
------------------------------------------------------------------------
The Debian Project                                http://www.debian.org/
Debian プロジェクトニュース  debian-publicity <at> lists.debian.org
2012 年 4 月 30 日               http://www.debian.org/News/weekly/2012/09/
------------------------------------------------------------------------

今年 9 号目の DPN、Debian コミュニティの会報、にようこそ。この号で取り上げられている話題は:

  * 自分の "クラウド" を Debian "Wheezy" 上に展開
  * ニカラグアの Debian ツアー
  * ESRF における Debian
  * DPL からの一言
  * インタビュー
  * その他のニュース
  * 今後のイベント
  * 新しい Debian 貢献者
  * 次期リリースに関するリリースクリティカルバグの統計
  * 重要な Debian セキュリティ勧告
  * 新規の注目パッケージ
  * 作業が必要なパッケージ
(Continue reading)

Thomas Blein | 15 May 2012 14:31
Picon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Ryuunosuke,

Quoting "AYANOKOUZI, Ryuunosuke" <i38w7i3 <at> yahoo.co.jp>:
> Here is an another type of bug on DPNhtml2mail.pl when generating a
> Japanese version of DPN. This comes out because of ad-hoc handling
> of UTF-8 flagged data. I have attached a debugged DPNhtml2mail.pl to
> this mail. please check it.

Thanks a lot for your input. UTF-8 as been always a mess for me and  
your solution looks to do its job nicely. I will have a look this  
evening (CEST) to see how its behave for latin languages.

On lines 112 to 136 there are language specific information. Do not  
hesitate to provide such information for Japanese if it make sens.

Regards,

Thomas

Thomas Blein | 15 May 2012 20:43
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Ryuunosuke,

Le mardi 15 mai 2012 à 14:31:45 (+0200), Thomas Blein a écrit :
> Quoting "AYANOKOUZI, Ryuunosuke" <i38w7i3 <at> yahoo.co.jp>:
> >Here is an another type of bug on DPNhtml2mail.pl when generating a
> >Japanese version of DPN. This comes out because of ad-hoc handling
> >of UTF-8 flagged data. I have attached a debugged DPNhtml2mail.pl to
> >this mail. please check it.

I made some small modification to the code mainly for the links. The
result is fine in Latin languages, could you please check that it is
still fine for Japanese.

Thanks again for your input.

Regards,

Thomas
Attachment (DPNhtml2mail.pl.diff): text/x-diff, 2793 bytes
AYANOKOUZI, Ryuunosuke | 16 May 2012 01:30
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Thomas,

Thanks for your kind reply.

> > >Here is an another type of bug on DPNhtml2mail.pl when generating a
> > >Japanese version of DPN. This comes out because of ad-hoc handling
> > >of UTF-8 flagged data. I have attached a debugged DPNhtml2mail.pl to
> > >this mail. please check it.
>
> I made some small modification to the code mainly for the links. The
> result is fine in Latin languages, could you please check that it is
> still fine for Japanese.

It is not suitable for ours. In Japanese, usually add single white
space after reference index for viewability because space is not used
in pure Japanese context except at the start of a paragraph.

Modification:

1. exclude link format option to language specific section.
2. delete mailto URL scheme from link section.

Regards,
AYANOKOUZI, Ryuunosuke
--
AYANOKOUZI, Ryuunosuke <i38w7i3 <at> yahoo.co.jp>
Attachment (DPNhtml2mail.pl.patch): application/octet-stream, 1437 bytes
Attachment (DPNhtml2mail.pl): application/octet-stream, 12 KiB
Thomas Blein | 16 May 2012 11:10
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Ryuunosuke,

Thanks for your patch, and particularly for fixing the regression of the
mailto that I did not saw.

I put everything in the SVN in 2 commit for a better history.
In addition, I added you in the author since you made quite a lot for
the script.

I got also an answer from Jean-Edouard and correct the header of the
file. Let me know if there is any problem with it.

Best regards,

Thomas

AYANOKOUZI, Ryuunosuke | 17 May 2012 16:11
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Thomas,

Here is another problem. if there is a br tag in a p tag, anything
after br tag will be neglected as shown below.

$ perl DPNhtml2mail.pl -i 2012/03 -l en

(snip)

Report from Debian Med sprint
-----------------------------

Andreas Tille sent a report from the Debian Med sprint [6] held in
Southport, UK on 27-29 January. Among other activities, the Debian Med
team fixed some bugs, mentored new members and students (consolidating
the effort made via the "Mentoring of the Month" initiative [7]) and
packaged new software. real time activity page [8].

    6 : http://lists.debian.org/debian-med/2012/01/msg00452.html
    7 : http://wiki.debian.org/DebianMed/MoM
    8 : http://debian-med.alioth.debian.org/

(snip)

I attached a patch for this problem. After apply the patch, it works
fine as shown below.

$ perl DPNhtml2mail.pl -i 2012/03 -l en

(snip)
(Continue reading)

Thomas Blein | 17 May 2012 16:34
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Ryuunosuke,

Le jeudi 17 mai 2012 à 23:11:45 (+0900), AYANOKOUZI, Ryuunosuke a écrit :
> Here is another problem. if there is a br tag in a p tag, anything
> after br tag will be neglected as shown below.

Thanks: my mistake when I was fusing the code of DPNhtml2mail.pl and
DNhtml2mail.pl.

Regards,

Thomas

--

-- 
To UNSUBSCRIBE, email to debian-publicity-request <at> lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster <at> lists.debian.org
Archive: http://lists.debian.org/20120517143411.GB18060 <at> tblein.eu

AYANOKOUZI, Ryuunosuke | 25 May 2012 06:14
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Thomas,

Thanks to your commit which supports Unicode table layout,
html to mail converter works fine in Japanese also.

Here is my comment, please find attached patch file also.

1.
I think it is better to merge UnicodeFormatTable module into
DPNhtml2mail.pl. Because UnicodeFormatTable.pm is almost similar to
Text/FormatTable.pm. once Text::FormatTable updated, we must find
difference comparing with UnicodeFormatTable. It's a pain isn't it? I
make UnicodeFormatTable into sub-classed module with Text::FormatTable
base class which override _uncolorized_length, _min_width, _wrap
methods.

2.
According to perldoc utf8, utf8::decode() is not recommend to use for
any string variable, is only for string literal. Because this function
does not handle arbitrary encodings. Using Encode::decode_utf8() is
recommended for the general purposes.

3.
I hope original Text::FormatTable supports Unicode table also in near
feature. I've send a pull request to upstream via github on May 23. It
is somewhat different from your code but is also working fine.  But
while reviewing your updates, I've got a hint from your code. I've
revised the code, and I'm sending another pull request.

Regards,
(Continue reading)

Thomas Blein | 25 May 2012 10:54
Picon
Favicon

Re: New version of DPNhtml2mail.pl [was: Possible bug when generating mail version]

Dear Ryuunosuke,

Thanks a lot for your support and proposed updated.
Effectively what you proposed let thinks far more cleaner than my
propositions. I still have a lot to learn about perl!

Thanks a lot also for the pull request to upstream.

Do not hesitate to join the publicity group on alioth if not already the
case. Like this you will be able to push directly your changes in
the SVN repositories with maybe smaller patches to make David happier :)

Best regards,

Thomas


Gmane