Discussion about Leafnode, a USENET software package designed for small sites running any flavour of Unix

Thufir | 24 May 2012 16:13

large volume (binary) groups

Leafnode doesn't handle binary groups well?

"Leafnode was not made for binary newsgroups. It is a "private" news-
_server_ and not a offline reader (though you can use it to fetch news 
online, store and read them offline)."

https://groups.google.com/group/alt.linux/msg/6877c648f696d94c?
dmode=source&output=gplain&noredirect

Could it be possible to have two different leafnode servers running, one 
for binary groups?  Or, is INN the better tool for grabbing binaries?  I 
have a slower broadband connection, and don't mind large download so long 
as they're in the background and not, for instance, holding up leafnode 
getting gmane text mailing list groups or something.

thanks,

Thufir

headers

sonic-news support | 24 May 2012 17:41

Re: large volume (binary) groups

nntpcache is better for binaries groups.  It caches the overviews, and 
only downloads and caches the body when a user asks for it. 
Unfortunately development has stopped since Julian Assange became 
involved with other projects.

Etian

On 05/24/2012 10:13 AM, Thufir wrote:
> Leafnode doesn't handle binary groups well?
>
> "Leafnode was not made for binary newsgroups. It is a "private" news-
> _server_ and not a offline reader (though you can use it to fetch news
> online, store and read them offline)."
>
> https://groups.google.com/group/alt.linux/msg/6877c648f696d94c?
> dmode=source&output=gplain&noredirect
>
>
>
> Could it be possible to have two different leafnode servers running, one
> for binary groups?  Or, is INN the better tool for grabbing binaries?  I
> have a slower broadband connection, and don't mind large download so long
> as they're in the background and not, for instance, holding up leafnode
> getting gmane text mailing list groups or something.
>
>
>
> thanks,
>
> Thufir

(Continue reading)

headers

Gary R. Schmidt | 25 May 2012 01:52

Re: large volume (binary) groups

On 25/05/2012 12:13 AM, Thufir wrote:
> Leafnode doesn't handle binary groups well?
>
It seems to handle them well enough for me - but I only have a have a 
couple that are active, and not much traffic in them.

Leafnode doesn't do anything with newsgroups apart from store the data. 
  If you want something that decodes the files and assembles them and so 
on, that's not what Leafnode does.  It is a news server pure and simple.

But if you are looking at pulling down large amounts of traffic, or 
keeping news for a long period, a full NNTP-based system, such as INN, 
is what you need.

Leafnode goes over the list of active newsgroups and pulls down the 
messages that have not been seen for each one - just like a news reader 
does.  So, yes, pulling down vast amounts of binaries will stop you 
receiving other groups until they complete.

	Cheers,
		Gary	B-)

headers

Werner Geuens | 26 May 2012 00:18

Re: large volume (binary) groups

On Thursday 24 May 2012 16:13 Thufir wrote:
> Leafnode doesn't handle binary groups well?

Of course it does, why not?

> Could it be possible to have two different leafnode servers running, one
> for binary groups?  Or, is INN the better tool for grabbing binaries?  I
> have a slower broadband connection, and don't mind large download so long
> as they're in the background and not, for instance, holding up leafnode
> getting gmane text mailing list groups or something.
>

I use leafnode for both binaries and regular news.

When I had a fast feed from my provider (and they counted nightly downloads 
for half volume towards my download limit), I used to get binaries at night, 
text-only groups during the day.

Now, I'm on a slow server, so I run text fetches every 15 min, binaries every 
hour.

By text-only, I mean a fetch that excludes some group masks, such as below:
sudo -u news  env "LN_SKIP_GROUPS=alt.bin*,alt.multi*" /usr/sbin/fetchnews -vv

Binary downloads are actually normal, full download that pick up both binaries 
and text. So, no masks:
sudo -u news  /usr/sbin/fetchnews -vv

--

--

(Continue reading)