Task length varying a LOT

Message boards : Number crunching : Task length varying a LOT
Message board moderation

To post messages, you must log in.

AuthorMessage
[AF>EDLS]zOU

Send message
Joined: 27 Feb 16
Posts: 4
Credit: 9,931,755
RAC: 56,701
Message 2682 - Posted: 14 Mar 2020, 11:15:49 UTC

Well, on one of my computer, WU calculation length goes from 1h to 12h:

https://docs.google.com/spreadsheets/d/1O4lnYzuh7xHEFKyyKzAIDyyHafwLOz-8FjjxxL5ZjrA/edit?usp=sharing

Computer: https://numberfields.asu.edu/NumberFields/show_host_detail.php?hostid=2349835

Is there a reason for this ?
(it happens to all of my machines, this one is just an exemple as I happen to have >300 tasks pending to send)
ID: 2682 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1188
Credit: 228,205,623
RAC: 225,732
Message 2683 - Posted: 14 Mar 2020, 16:05:51 UTC - in response to Message 2682.  

Well, on one of my computer, WU calculation length goes from 1h to 12h:

https://docs.google.com/spreadsheets/d/1O4lnYzuh7xHEFKyyKzAIDyyHafwLOz-8FjjxxL5ZjrA/edit?usp=sharing

Computer: https://numberfields.asu.edu/NumberFields/show_host_detail.php?hostid=2349835

Is there a reason for this ?
(it happens to all of my machines, this one is just an exemple as I happen to have >300 tasks pending to send)


On a 4GHz single treaded core I see times ranging from .3 hrs to 4 hrs with an average of 1.8 hrs (very rarely there are outliers that are only a few seconds, but I will ignore those).
The ratio of slowest to fastest is ~13, which is in line with your observation.

The quick answer is yes, there is a well understood reason for it. The smallest unit in a dataset is a congruence vector. This latest case (14x271) has 19,660,800 Cvecs total. I decided to break the case into 3,932,160 WUs with 5 Cvecs per WU. The time for a single Cvec has high variance, so the more Cvecs per WU the more uniform the time. I try not to go below 5 Cvecs per WU, otherwise the variance is too high (as you are seeing here). On the flip side, increasing the Cvecs per WU reduces the variance, but the average time goes up.
ID: 2683 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Task length varying a LOT


Main page · Your account · Message boards


Copyright © 2022 Arizona State University