Gentoo Linux developer list

Federico "fox" Scrinzi | 27 Jun 2012 09:51

Picon

euscan GSoC project - requesting feedback

Hi everybody!

I'm working on a GSoC project for enhancing Euscan
(http://euscan.iksaif.net/). Euscan allows to check if a given
package/ebuild has new upstream versions or not. It uses different
heuristic to scan upstream and grab new versions and related urls.
Euscan has a web interface for surfing data but for now is only possible
to see the scan results per package/category/herd/maintainers/overlay.
We're working now on the possibility to register and provide a cool
dashboard for maintainers, so that they can easily keep an eye on the
upstream versions of the packages they maintain.

The main question is: what would you like to have on this dashboard?
Currently (in the development version) there's the possibility to login
and watch/unwatch packages/categories/herds/... and see the watched
stuff in the account dashboard. We're planning on implementing a
weekly(?) custom newsletter based on the packages you're watching, which
features would you like?

The project repo for the GSoC is here: https://github.com/volpino/euscan

Thanks!

--

-- 
f.

  "Always code as if the guy who ends up maintaining your code will be a
   violent psychopath who knows where you live."
  (Martin Golding)

(Continue reading)

Dirkjan Ochtman | 27 Jun 2012 10:00

Picon

Re: euscan GSoC project - requesting feedback

On Wed, Jun 27, 2012 at 9:51 AM, Federico "fox" Scrinzi <fox91 <at> anche.no> wrote:
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?

- The ability to pick what overlays I care about
- Ignore alpha/beta versions if the current gentoo-x86 version is not alpha/beta
- Candidates for stabilization

Cheers,

Dirkjan

Michael Weber | 27 Jun 2012 11:29

Picon

Re: euscan GSoC project - requesting feedback


On 06/27/2012 10:00 AM, Dirkjan Ochtman wrote:
> On Wed, Jun 27, 2012 at 9:51 AM, Federico "fox" Scrinzi
> <fox91 <at> anche.no> wrote:
>> The main question is: what would you like to have on this
>> dashboard? Currently (in the development version) there's the
>> possibility to login and watch/unwatch
>> packages/categories/herds/... and see the watched stuff in the
>> account dashboard. We're planning on implementing a weekly(?)
>> custom newsletter based on the packages you're watching, which 
>> features would you like?
> 
> - The ability to pick what overlays I care about - Ignore
> alpha/beta versions if the current gentoo-x86 version is not
> alpha/beta - Candidates for stabilization
> 

a request rescan button

a Report problem machanism.
   i.e. on http://euscan.iksaif.net/maintainers/48/ there's an
   inconsistency between both "upstream" and "version in gentoo"
   being 2012.2.0 but there's still a light red marker.

Great tool, thanks.

   Michael

--
Gentoo Dev

(Continue reading)

Jeroen Roovers | 28 Jun 2012 17:33

Picon

Re: euscan GSoC project - requesting feedback

On Wed, 27 Jun 2012 11:29:49 +0200
Michael Weber <xmw <at> gentoo.org> wrote:

> - - a Report problem machanism.
>    i.e. on http://euscan.iksaif.net/maintainers/48/ there's an
>    inconsistency between both "upstream" and "version in gentoo"
>    being 2012.2.0 but there's still a light red marker.

And in the same spirit, a way to report when the scans generate false
positives in version matching.

     jer

Michał Górny | 27 Jun 2012 16:33

Picon

Re: euscan GSoC project - requesting feedback

On Wed, 27 Jun 2012 09:51:06 +0200
"Federico \"fox\" Scrinzi" <fox91 <at> anche.no> wrote:

> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to
> login and watch/unwatch packages/categories/herds/... and see the
> watched stuff in the account dashboard. We're planning on
> implementing a weekly(?) custom newsletter based on the packages
> you're watching, which features would you like?

RSS/atom feeds as an alternative to the newsletter.

> The project repo for the GSoC is here:
> https://github.com/volpino/euscan

Is the development version running somewhere already so we could play
with it a bit?

--

-- 
Best regards,
Michał Górny

Federico "fox" Scrinzi | 28 Jun 2012 08:10

Picon

Re: euscan GSoC project - requesting feedback

On 27/06/2012 16:33, Michał Górny wrote:
> Is the development version running somewhere already so we could play
> with it a bit?

For now is not available unfortunately :( We'll try to set it up!

Thank you everybody for your feedback! The RSS feed is already
implemented globally, we'll just tweak it to have a per user feed.

I didn't considered the fact of separate stable and unstable but it's
indeed a really cool feature.

--

-- 
f.

  "Always code as if the guy who ends up maintaining your code will be a
   violent psychopath who knows where you live."
  (Martin Golding)

Andreas K. Huettel | 27 Jun 2012 17:08

Picon

Re: euscan GSoC project - requesting feedback

> The main question is: what would you like to have on this dashboard?

Not only the information whether ~arch is outdated, but also whether stable is 
outdated...

> custom newsletter based on the packages you're watching, 

please also as rss feed...

cheers, 
andreas

--

-- 
Andreas K. Huettel
Gentoo Linux developer
kde, sci, arm, tex, printing

Michael Palimaka | 28 Jun 2012 11:26

Picon

Re: euscan GSoC project - requesting feedback

On 2012-06-27 17:51, Federico "fox" Scrinzi wrote:
> Hi everybody!
>
> I'm working on a GSoC project for enhancing Euscan
> (http://euscan.iksaif.net/). Euscan allows to check if a given
> package/ebuild has new upstream versions or not. It uses different
> heuristic to scan upstream and grab new versions and related urls.
> Euscan has a web interface for surfing data but for now is only possible
> to see the scan results per package/category/herd/maintainers/overlay.
> We're working now on the possibility to register and provide a cool
> dashboard for maintainers, so that they can easily keep an eye on the
> upstream versions of the packages they maintain.
>
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?
>
> The project repo for the GSoC is here: https://github.com/volpino/euscan
>
> Thanks!
>

Looking forward to seeing the improvements. :)

I'd like to see the information regarding current tree state updated 
more regularly than the full upstream scan. Especially when looking at 
the herd view, it can be hard to keep track of which bumps have already

(Continue reading)

Andreas K. Huettel | 28 Jun 2012 12:50

Picon

Re: Re: euscan GSoC project - requesting feedback

> I'd like to see the information regarding current tree state updated
> more regularly than the full upstream scan. Especially when looking at
> the herd view, it can be hard to keep track of which bumps have already
> been completed.

Good idea- it should be much cheaper to do the tree update than to re-scan 
upstream...

--

-- 
Andreas K. Huettel
Gentoo Linux developer
kde, sci, arm, tex, printing

Kent Fredric | 29 Jun 2012 04:07

Picon

Re: euscan GSoC project - requesting feedback

On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91 <at> anche.no> wrote:
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?
>
> The project repo for the GSoC is here: https://github.com/volpino/euscan
>
> Thanks!
>

For the most part it seems to get upstream / portage versioning right,
but occasionally you get miss-matches for some reason.

It would be nice to allow to provide some mapping mechanism that
existed on the overlay itself to inform euscan how to map upstream
versions to downstream ones, but implementing that would be far too
complex I feel.

Instead, it would be nice to have a mechanism in the interface to set
a "Upstream version is" value for each package if euscan can't tell.

Ie:

http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/

Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these
are in fact the same version. So in 0.710.0 , it would be nice to be

(Continue reading)

Duncan | 29 Jun 2012 07:32

Picon

Re: euscan GSoC project - requesting feedback

Kent Fredric posted on Fri, 29 Jun 2012 14:07:58 +1200 as excerpted:

> For the most part it seems to get upstream / portage versioning right,
> but occasionally you get miss-matches for some reason.
> 
> It would be nice to allow to provide some mapping mechanism that existed
> on the overlay itself to inform euscan how to map upstream versions to
> downstream ones, but implementing that would be far too complex I feel.
> 
> Instead, it would be nice to have a mechanism in the interface to set a
> "Upstream version is" value for each package if euscan can't tell.
> 
> Ie:
> 
> http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/
> 
> Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these are
> in fact the same version. So in 0.710.0 , it would be nice to be able to
> set the upstream version manually to 0.71 so that euscan no longer
> reported it as outdated.

What about a simple variable that can be set in the ebuild?  Say for the 
above example something like:

EUSCAN_VERSION=0.71

I don't know how difficult that would be for euscan to pickup on, but 
since this would have no bearing on actual package behavior, only on 
euscan, I'd guess it shouldn't require going thru the formal PMS process, 
tho specifying it well enough to know whether it can be a function or

(Continue reading)

Kent Fredric | 29 Jun 2012 18:43

Picon

Re: Re: euscan GSoC project - requesting feedback

On 29 June 2012 17:32, Duncan <1i5t5.duncan <at> cox.net> wrote:
>
> EUSCAN_VERSION=0.71
>
> I don't know how difficult that would be for euscan to pickup on, but
> since this would have no bearing on actual package behavior, only on
> euscan, I'd guess it shouldn't require going thru the formal PMS process,
> tho specifying it well enough to know whether it can be a function or
> must be a straight variable assignment, etc, as well as whether quotes
> are required or not, would be useful, and that's normally part of the PMS
> process so at least getting input from them would be useful.
>
> Alternatively, define some formula that can be placed in the package's
> metadata.xml.  That's perhaps a better functionality match (we're talking
> about metadata, after all), but getting a formula that can deal with all
> the corner-cases is likely to be more difficult (and take longer) than
> simply specifying a variable to be defined for each ebuild that euscan
> can't immediately get correct.

The problem is with this approach, some devs will want to set
EUSCAN_VERSION automagically using mangling $PV

As it is, we *already* have something equivalent to EUSCAN_VERSION for
things derived from perl-module.eclass, MODULE_VERSION=

Its not 1:1 identical to the intent of EUSCAN_VERSION, MODULE_VERSION
is only really required in the generation of SRC_URI , but because of
this, there is a loose MODULE_VERSION <-> distfile mapping, and a much
looser $PV <-> MODULE_VERSION association.

(Continue reading)

Michał Górny | 29 Jun 2012 08:53

Picon

Re: euscan GSoC project - requesting feedback

On Fri, 29 Jun 2012 14:07:58 +1200
Kent Fredric <kentfredric <at> gmail.com> wrote:

> On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91 <at> anche.no> wrote:
> > The main question is: what would you like to have on this dashboard?
> > Currently (in the development version) there's the possibility to
> > login and watch/unwatch packages/categories/herds/... and see the
> > watched stuff in the account dashboard. We're planning on
> > implementing a weekly(?) custom newsletter based on the packages
> > you're watching, which features would you like?
> >
> > The project repo for the GSoC is here:
> > https://github.com/volpino/euscan
> >
> > Thanks!
> >
> 
> For the most part it seems to get upstream / portage versioning right,
> but occasionally you get miss-matches for some reason.
> 
> It would be nice to allow to provide some mapping mechanism that
> existed on the overlay itself to inform euscan how to map upstream
> versions to downstream ones, but implementing that would be far too
> complex I feel.
> 
> Instead, it would be nice to have a mechanism in the interface to set
> a "Upstream version is" value for each package if euscan can't tell.
> 
> Ie:
>

(Continue reading)

Corentin Chary | 29 Jun 2012 14:13

Picon

Re: euscan GSoC project - requesting feedback

On Fri, Jun 29, 2012 at 8:53 AM, Michał Górny <mgorny <at> gentoo.org> wrote:
> On Fri, 29 Jun 2012 14:07:58 +1200
> Kent Fredric <kentfredric <at> gmail.com> wrote:
>
>> On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91 <at> anche.no> wrote:
>> > The main question is: what would you like to have on this dashboard?
>> > Currently (in the development version) there's the possibility to
>> > login and watch/unwatch packages/categories/herds/... and see the
>> > watched stuff in the account dashboard. We're planning on
>> > implementing a weekly(?) custom newsletter based on the packages
>> > you're watching, which features would you like?
>> >
>> > The project repo for the GSoC is here:
>> > https://github.com/volpino/euscan
>> >
>> > Thanks!
>> >
>>
>> For the most part it seems to get upstream / portage versioning right,
>> but occasionally you get miss-matches for some reason.
>>
>> It would be nice to allow to provide some mapping mechanism that
>> existed on the overlay itself to inform euscan how to map upstream
>> versions to downstream ones, but implementing that would be far too
>> complex I feel.
>>
>> Instead, it would be nice to have a mechanism in the interface to set
>> a "Upstream version is" value for each package if euscan can't tell.
>>
>> Ie:

(Continue reading)

Kent Fredric | 29 Jun 2012 18:54

Picon

Re: euscan GSoC project - requesting feedback

On 30 June 2012 00:13, Corentin Chary <iksaif <at> gentoo.org> wrote:

> It's already the case:
> https://github.com/iksaif/euscan/blob/master/pym/euscan/handlers/cpan.py
> but my mangling functions are probably broken in some cases. If
> somebody with a better knowledge of CPAN versionning scheme could fix
> them it would be great !
>
> Thanks,

The thing is there isn't a true versioning scheme for CPAN, just a
defacto one agreed upon by the community.  There are several
versioning schemes in employ, but the mechanics of each are rather
messy, and then  you have some lovely fellow like pip come along and
put garbage in their version, and we have to handle it manually.

For the most part though, people use "sensible" versions of a very few
basic varieties, and we downstream normalise these smattering of
varieties into a single form to make everything nice and tidy.  Its
still a work in progress migrating older ebuilds to our new
normalisation scheme, but its getting there.

And we do have a tool that will convert /most/ CPAN versions into
portage versions, which works as long as upstream are sane:

    dev-perl/Gentoo-PerlMod-Version

Which relies on another perl module 'version.pm' (
virtual/perl-version ) which handles most the real dirty work of
normalising things, and we just do a bit of post-processing of that to

(Continue reading)

Corentin Chary | 29 Jun 2012 14:09

Picon

Re: euscan GSoC project - requesting feedback

On Fri, Jun 29, 2012 at 4:07 AM, Kent Fredric <kentfredric <at> gmail.com> wrote:
> On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91 <at> anche.no> wrote:
>> The main question is: what would you like to have on this dashboard?
>> Currently (in the development version) there's the possibility to login
>> and watch/unwatch packages/categories/herds/... and see the watched
>> stuff in the account dashboard. We're planning on implementing a
>> weekly(?) custom newsletter based on the packages you're watching, which
>> features would you like?
>>
>> The project repo for the GSoC is here: https://github.com/volpino/euscan
>>
>> Thanks!
>>
>
> For the most part it seems to get upstream / portage versioning right,
> but occasionally you get miss-matches for some reason.
>
> It would be nice to allow to provide some mapping mechanism that
> existed on the overlay itself to inform euscan how to map upstream
> versions to downstream ones, but implementing that would be far too
> complex I feel.
>
> Instead, it would be nice to have a mechanism in the interface to set
> a "Upstream version is" value for each package if euscan can't tell.
>
> Ie:
>
> http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/
>
> Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these

(Continue reading)

Andreas K. Huettel | 30 Jun 2012 21:21

Picon

Re: euscan GSoC project - requesting feedback

Am Mittwoch, 27. Juni 2012, 09:51:06 schrieb Federico "fox" Scrinzi:
> The main question is: what would you like to have on this dashboard?

Here's another suggestion for euscan: right now we already have rss feeds, but 
they are far too verbose for me and clutter up my news list. I dont really 
need an item whenever something enters portage

How about a news feed that only contains "upstream" items?

Cheers, 
Andreas

--

-- 
Andreas K. Huettel
Gentoo Linux developer 
kde (team lead), sci, tex, arm, printing
dilfridge <at> gentoo.org
http://www.akhuettel.de/

Return

Return to gmane.linux.gentoo.devel.

Search Archive

Language

Change language

Options

Current view: Threads only / Showing only 20 lines / Not hiding cited text.
Change to All messages, whole messages, or hide cited text.

Post a message
NNTP Newsgroup
Classic Gmane web interface
XML

XML

RSS Feed
List Information

About Gmane