headers
Julian Elischer | 2 Dec 2011 03:06
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/1/11 5:03 PM, Julian Elischer wrote:
> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet 
> link, I now see that teh upgrade process does one file at a time.
> it would be a lot faster to overlap the downloads if it were 
> possible. Does the upgrade process know of more than one file that 
> it needs to get?

One could at least make the fetch of the checksum file be done in 
parallel, so that the tcp handshake is done during the transfer of the 
main file.
Looking at my system upgrading however it looks as though there is 
something else that should be found too.
It's 95 % idle, yet it is only asking for each file, one at a time 
with large gaps between them.(10 seconds)?
Disk I doesn't seem to be  a bottleneck either so I can't work out 
what the holdup is.

>
>
> Julian
> _______________________________________________
> Testing mailing list
> Testing@...
> http://lists.pcbsd.org/mailman/listinfo/testing
>
Permalink | Reply |
headers
Kris Moore | 5 Dec 2011 17:02
Gravatar

Re: upgrading.. slower than needs be

On 12/01/2011 21:06, Julian Elischer wrote:
> On 12/1/11 5:03 PM, Julian Elischer wrote:
>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>> link, I now see that teh upgrade process does one file at a time.
>> it would be a lot faster to overlap the downloads if it were
>> possible. Does the upgrade process know of more than one file that it
>> needs to get?
>
> One could at least make the fetch of the checksum file be done in
> parallel, so that the tcp handshake is done during the transfer of the
> main file.
> Looking at my system upgrading however it looks as though there is
> something else that should be found too.
> It's 95 % idle, yet it is only asking for each file, one at a time
> with large gaps between them.(10 seconds)?
> Disk I doesn't seem to be  a bottleneck either so I can't work out
> what the holdup is.

I'll see what we can do to speed this up :) Parallel downloads would
help for sure, if anything we can do the md5 at the same time.

--

-- 
Kris Moore
PC-BSD Software
iXsystems
Permalink | Reply |
headers
Julian Elischer | 5 Dec 2011 19:18
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/5/11 8:02 AM, Kris Moore wrote:
> On 12/01/2011 21:06, Julian Elischer wrote:
>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>> link, I now see that teh upgrade process does one file at a time.
>>> it would be a lot faster to overlap the downloads if it were
>>> possible. Does the upgrade process know of more than one file that it
>>> needs to get?
>>
>> One could at least make the fetch of the checksum file be done in
>> parallel, so that the tcp handshake is done during the transfer of the
>> main file.
>> Looking at my system upgrading however it looks as though there is
>> something else that should be found too.
>> It's 95 % idle, yet it is only asking for each file, one at a time
>> with large gaps between them.(10 seconds)?
>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>> what the holdup is.
>
> I'll see what we can do to speed this up :) Parallel downloads would
> help for sure, if anything we can do the md5 at the same time.

unfortunately I have now upgraded so I can't do it again to test, but
I could se no reason as to why it was so slow.

teh disk was barely being touched, and there was only 5% cpu usage, 
and teh network IO was only sporadic.. it would do aburst of high 
bandwidth where it downloaded the file, then there would be a blip 
where it did someting on cpu then a 5 second gap of nothing then the 
md 5 would be received and then another 5 seconds of nothing much, and
(Continue reading)

Permalink | Reply |
headers
Kris Moore | 5 Dec 2011 21:16
Gravatar

Re: upgrading.. slower than needs be

On 12/05/2011 13:18, Julian Elischer wrote:
> On 12/5/11 8:02 AM, Kris Moore wrote:
>> On 12/01/2011 21:06, Julian Elischer wrote:
>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>>> link, I now see that teh upgrade process does one file at a time.
>>>> it would be a lot faster to overlap the downloads if it were
>>>> possible. Does the upgrade process know of more than one file that it
>>>> needs to get?
>>>
>>> One could at least make the fetch of the checksum file be done in
>>> parallel, so that the tcp handshake is done during the transfer of the
>>> main file.
>>> Looking at my system upgrading however it looks as though there is
>>> something else that should be found too.
>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>> with large gaps between them.(10 seconds)?
>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>> what the holdup is.
>>
>> I'll see what we can do to speed this up :) Parallel downloads would
>> help for sure, if anything we can do the md5 at the same time.
>
> unfortunately I have now upgraded so I can't do it again to test, but
> I could se no reason as to why it was so slow.
>
> teh disk was barely being touched, and there was only 5% cpu usage,
> and teh network IO was only sporadic.. it would do aburst of high
> bandwidth where it downloaded the file, then there would be a blip
> where it did someting on cpu then a 5 second gap of nothing then the
(Continue reading)

Permalink | Reply |
headers
Julian Elischer | 6 Dec 2011 07:42
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/5/11 10:18 AM, Julian Elischer wrote:
> On 12/5/11 8:02 AM, Kris Moore wrote:
>> On 12/01/2011 21:06, Julian Elischer wrote:
>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>>> link, I now see that teh upgrade process does one file at a time.
>>>> it would be a lot faster to overlap the downloads if it were
>>>> possible. Does the upgrade process know of more than one file 
>>>> that it
>>>> needs to get?
>>>
>>> One could at least make the fetch of the checksum file be done in
>>> parallel, so that the tcp handshake is done during the transfer of 
>>> the
>>> main file.
>>> Looking at my system upgrading however it looks as though there is
>>> something else that should be found too.
>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>> with large gaps between them.(10 seconds)?
>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>> what the holdup is.
>>
>> I'll see what we can do to speed this up :) Parallel downloads would
>> help for sure, if anything we can do the md5 at the same time.
>
> unfortunately I have now upgraded so I can't do it again to test, but
> I could se no reason as to why it was so slow.
>
> The disk was barely being touched, and there was only 5% cpu usage, 
> and teh network IO was only sporadic.. it would do aburst of high
(Continue reading)

Permalink | Reply |
headers
Kris Moore | 6 Dec 2011 16:36
Gravatar

Re: upgrading.. slower than needs be

On 12/06/2011 01:42, Julian Elischer wrote:
> On 12/5/11 10:18 AM, Julian Elischer wrote:
>> On 12/5/11 8:02 AM, Kris Moore wrote:
>>> On 12/01/2011 21:06, Julian Elischer wrote:
>>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>>>> link, I now see that teh upgrade process does one file at a time.
>>>>> it would be a lot faster to overlap the downloads if it were
>>>>> possible. Does the upgrade process know of more than one file that it
>>>>> needs to get?
>>>>
>>>> One could at least make the fetch of the checksum file be done in
>>>> parallel, so that the tcp handshake is done during the transfer of the
>>>> main file.
>>>> Looking at my system upgrading however it looks as though there is
>>>> something else that should be found too.
>>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>>> with large gaps between them.(10 seconds)?
>>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>>> what the holdup is.
>>>
>>> I'll see what we can do to speed this up :) Parallel downloads would
>>> help for sure, if anything we can do the md5 at the same time.
>>
>> unfortunately I have now upgraded so I can't do it again to test, but
>> I could se no reason as to why it was so slow.
>>
>> The disk was barely being touched, and there was only 5% cpu usage,
>> and teh network IO was only sporadic.. it would do aburst of high
>> bandwidth where it downloaded the file, then there would be a blip
(Continue reading)

Permalink | Reply |
headers
Julian Elischer | 16 Dec 2011 17:35
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/5/11 8:02 AM, Kris Moore wrote:
> On 12/01/2011 21:06, Julian Elischer wrote:
>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>> link, I now see that teh upgrade process does one file at a time.
>>> it would be a lot faster to overlap the downloads if it were
>>> possible. Does the upgrade process know of more than one file that it
>>> needs to get?
>>
>> One could at least make the fetch of the checksum file be done in
>> parallel, so that the tcp handshake is done during the transfer of the
>> main file.
>> Looking at my system upgrading however it looks as though there is
>> something else that should be found too.
>> It's 95 % idle, yet it is only asking for each file, one at a time
>> with large gaps between them.(10 seconds)?
>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>> what the holdup is.
>
> I'll see what we can do to speed this up :) Parallel downloads would
> help for sure, if anything we can do the md5 at the same time.
>

looking at the new announcement..

several other things
In RC2 when I try log in as root to do the upgrade to RC3 lots of 
windows come up 'greyed out' and I can't make the take notice..  for 
example the upgrade control window.. not  idea what that is about.
(Continue reading)

Permalink | Reply |
headers
Kris Moore | 16 Dec 2011 17:54
Gravatar

Re: upgrading.. slower than needs be

On 12/16/2011 11:35, Julian Elischer wrote:
> On 12/5/11 8:02 AM, Kris Moore wrote:
>> On 12/01/2011 21:06, Julian Elischer wrote:
>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>>> link, I now see that teh upgrade process does one file at a time.
>>>> it would be a lot faster to overlap the downloads if it were
>>>> possible. Does the upgrade process know of more than one file that it
>>>> needs to get?
>>>
>>> One could at least make the fetch of the checksum file be done in
>>> parallel, so that the tcp handshake is done during the transfer of the
>>> main file.
>>> Looking at my system upgrading however it looks as though there is
>>> something else that should be found too.
>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>> with large gaps between them.(10 seconds)?
>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>> what the holdup is.
>>
>> I'll see what we can do to speed this up :) Parallel downloads would
>> help for sure, if anything we can do the md5 at the same time.
>>
>
> looking at the new announcement..
>
> several other things
> In RC2 when I try log in as root to do the upgrade to RC3 lots of
> windows come up 'greyed out' and I can't make the take notice..  for
> example the upgrade control window.. not  idea what that is about.
(Continue reading)

Permalink | Reply |
headers
Julian Elischer | 18 Dec 2011 10:27
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/16/11 8:54 AM, Kris Moore wrote:
> On 12/16/2011 11:35, Julian Elischer wrote:
>> On 12/5/11 8:02 AM, Kris Moore wrote:
>>> On 12/01/2011 21:06, Julian Elischer wrote:
>>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec internet
>>>>> link, I now see that teh upgrade process does one file at a time.
>>>>> it would be a lot faster to overlap the downloads if it were
>>>>> possible. Does the upgrade process know of more than one file that it
>>>>> needs to get?
>>>>
>>>> One could at least make the fetch of the checksum file be done in
>>>> parallel, so that the tcp handshake is done during the transfer of the
>>>> main file.
>>>> Looking at my system upgrading however it looks as though there is
>>>> something else that should be found too.
>>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>>> with large gaps between them.(10 seconds)?
>>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>>> what the holdup is.
>>>
>>> I'll see what we can do to speed this up :) Parallel downloads would
>>> help for sure, if anything we can do the md5 at the same time.
>>>
>>
>> looking at the new announcement..
>>
>> several other things
>> In RC2 when I try log in as root to do the upgrade to RC3 lots of
>> windows come up 'greyed out' and I can't make the take notice..  for
(Continue reading)

Permalink | Reply |
headers
Julian Elischer | 18 Dec 2011 10:31
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/18/11 1:27 AM, Julian Elischer wrote:
> On 12/16/11 8:54 AM, Kris Moore wrote:
>> On 12/16/2011 11:35, Julian Elischer wrote:
>>> On 12/5/11 8:02 AM, Kris Moore wrote:
>>>> On 12/01/2011 21:06, Julian Elischer wrote:
>>>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec 
>>>>>> internet
>>>>>> link, I now see that teh upgrade process does one file at a time.
>>>>>> it would be a lot faster to overlap the downloads if it were
>>>>>> possible. Does the upgrade process know of more than one file 
>>>>>> that it
>>>>>> needs to get?
>>>>>
>>>>> One could at least make the fetch of the checksum file be done in
>>>>> parallel, so that the tcp handshake is done during the transfer 
>>>>> of the
>>>>> main file.
>>>>> Looking at my system upgrading however it looks as though there is
>>>>> something else that should be found too.
>>>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>>>> with large gaps between them.(10 seconds)?
>>>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>>>> what the holdup is.
>>>>
>>>> I'll see what we can do to speed this up :) Parallel downloads would
>>>> help for sure, if anything we can do the md5 at the same time.
>>>>
>>>
>>> looking at the new announcement..
(Continue reading)

Permalink | Reply |
headers
Julian Elischer | 18 Dec 2011 10:54
Picon
Favicon

Re: upgrading.. slower than needs be

On 12/18/11 1:31 AM, Julian Elischer wrote:
> On 12/18/11 1:27 AM, Julian Elischer wrote:
>> On 12/16/11 8:54 AM, Kris Moore wrote:
>>> On 12/16/2011 11:35, Julian Elischer wrote:
>>>> On 12/5/11 8:02 AM, Kris Moore wrote:
>>>>> On 12/01/2011 21:06, Julian Elischer wrote:
>>>>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec 
>>>>>>> internet
>>>>>>> link, I now see that teh upgrade process does one file at a time.
>>>>>>> it would be a lot faster to overlap the downloads if it were
>>>>>>> possible. Does the upgrade process know of more than one file 
>>>>>>> that it
>>>>>>> needs to get?
>>>>>>
>>>>>> One could at least make the fetch of the checksum file be done in
>>>>>> parallel, so that the tcp handshake is done during the transfer 
>>>>>> of the
>>>>>> main file.
>>>>>> Looking at my system upgrading however it looks as though there is
>>>>>> something else that should be found too.
>>>>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>>>>> with large gaps between them.(10 seconds)?
>>>>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>>>>> what the holdup is.
>>>>>
>>>>> I'll see what we can do to speed this up :) Parallel downloads 
>>>>> would
>>>>> help for sure, if anything we can do the md5 at the same time.
>>>>>
(Continue reading)

Permalink | Reply |
headers
Kris Moore | 19 Dec 2011 17:22
Gravatar

Re: upgrading.. slower than needs be

On 12/18/2011 04:54, Julian Elischer wrote:
> On 12/18/11 1:31 AM, Julian Elischer wrote:
>> On 12/18/11 1:27 AM, Julian Elischer wrote:
>>> On 12/16/11 8:54 AM, Kris Moore wrote:
>>>> On 12/16/2011 11:35, Julian Elischer wrote:
>>>>> On 12/5/11 8:02 AM, Kris Moore wrote:
>>>>>> On 12/01/2011 21:06, Julian Elischer wrote:
>>>>>>> On 12/1/11 5:03 PM, Julian Elischer wrote:
>>>>>>>> Watching the RC1->RC2 upgrade on my nice shiny new 15Mb/sec
>>>>>>>> internet
>>>>>>>> link, I now see that teh upgrade process does one file at a time.
>>>>>>>> it would be a lot faster to overlap the downloads if it were
>>>>>>>> possible. Does the upgrade process know of more than one file
>>>>>>>> that it
>>>>>>>> needs to get?
>>>>>>>
>>>>>>> One could at least make the fetch of the checksum file be done in
>>>>>>> parallel, so that the tcp handshake is done during the transfer
>>>>>>> of the
>>>>>>> main file.
>>>>>>> Looking at my system upgrading however it looks as though there is
>>>>>>> something else that should be found too.
>>>>>>> It's 95 % idle, yet it is only asking for each file, one at a time
>>>>>>> with large gaps between them.(10 seconds)?
>>>>>>> Disk I doesn't seem to be  a bottleneck either so I can't work out
>>>>>>> what the holdup is.
>>>>>>
>>>>>> I'll see what we can do to speed this up :) Parallel downloads would
>>>>>> help for sure, if anything we can do the md5 at the same time.
>>>>>>
(Continue reading)

Permalink | Reply |

Gmane