Qsqrt421_DS3x8 15+ hour running time?

Message boards : Number crunching : Qsqrt421_DS3x8 15+ hour running time?
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
frederikhk

Send message
Joined: 24 Aug 15
Posts: 3
Credit: 50,248
RAC: 0
Message 1596 - Posted: 12 Mar 2016, 21:09:21 UTC

Just finished the first one second one is reporting soon http://numberfields.asu.edu/NumberFields/result.php?resultid=15861831
ID: 1596 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1597 - Posted: 13 Mar 2016, 1:52:00 UTC - in response to Message 1596.  

Just finished the first one second one is reporting soon http://numberfields.asu.edu/NumberFields/result.php?resultid=15861831


Ignoring the handfull of really long WUs, 15+ hours is not uncommon, but most should be less than that.
ID: 1597 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1606 - Posted: 24 Mar 2016, 10:44:21 UTC

I don't know if this can be called "a handful".

I've got an entire bunch of really long running ones, even on really fast machines like an i7-3820 at 4,4Ghz.

These workunits will miss the deadline soon, you should think about extending the deadlines in general. I let these workunits run but I will be very disappointed when I can't get credit for it.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168339
http://numberfields.asu.edu/NumberFields/result.php?resultid=16168357
http://numberfields.asu.edu/NumberFields/result.php?resultid=16168378
ID: 1606 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1608 - Posted: 24 Mar 2016, 16:15:33 UTC - in response to Message 1606.  

I don't know if this can be called "a handful".

I've got an entire bunch of really long running ones, even on really fast machines like an i7-3820 at 4,4Ghz.

These workunits will miss the deadline soon, you should think about extending the deadlines in general. I let these workunits run but I will be very disappointed when I can't get credit for it.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168339
http://numberfields.asu.edu/NumberFields/result.php?resultid=16168357
http://numberfields.asu.edu/NumberFields/result.php?resultid=16168378


The ones you listed should finish within a few days. The worst I have seen on my computer is 80 hours; it's a small sample of the WU population, but I don't expect it to be much worse. The deadline and grace period is already set pretty high, so I would rather not adjust that anymore. If you miss the deadline and someone finishes the WU before you, I can manually grant you the credit, so don't worry about that.

The "handful" I was referring to were the ones that were taking between 2 and 4 weeks (sometimes longer depending on the host). These were extensively discussed in other threads. It turns out you do have a couple of those:
http://numberfields.asu.edu/NumberFields/result.php?resultid=16374076
http://numberfields.asu.edu/NumberFields/result.php?resultid=16197688
I have been monitoring these and there are only 8 left. When someone finishes one, I alert the other user with the same WU and give them manual credit for their trouble.
ID: 1608 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1610 - Posted: 25 Mar 2016, 1:13:11 UTC

Okay, that's good enough for me. One of the i7-3820's WUs I listed is now running for a week and that's a very fast machine on NumberFields.

someone finishes the WU before you

I don't think so... ;)
ID: 1610 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1611 - Posted: 25 Mar 2016, 10:32:37 UTC

The first two of my long running WUs I listed yesterday are down. Unfortunately, it found nothing.
# Inspected 2731542253 polynomials.
# Num Polys passing PolDisc test = 0 (0%).
# Num Polys passing irreducibility test = 0 (0%).
# Num Polys passing field disc test = 0 (0%).

But I've reconized another problem regarding Boinc credits with these WUs.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168378
ran for almost a week and scored 5,745.30 credits

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168357
ran for 4 days and 7 hours, scoring 5,745.30 credits too

Shouldn't there be a difference between these two because of the 2 1/2 day longer running time? I assume that these WUs reach an upper limit in the credit calculation process.
ID: 1611 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
MaynardVizzutti

Send message
Joined: 11 Apr 15
Posts: 4
Credit: 4,705,812
RAC: 7
Message 1612 - Posted: 25 Mar 2016, 21:22:57 UTC - in response to Message 1611.  

I also have seen this as of today. One WU consumed 373,000 CPU seconds and another 184,000 seconds, but both were granted 4,069 credits.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16170600
http://numberfields.asu.edu/NumberFields/result.php?resultid=16169189

As long as I'm here, let me compliment the project. This project has a very good level of communication and friendly responsiveness from the administrators, and I especially appreciate the batch status page, as I enjoy keeping track of the progress. Some projects are black holes that consume all the CPU you give them with no sense of progress. So, congratulations to this crew for providing that.
ID: 1612 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1613 - Posted: 25 Mar 2016, 22:45:33 UTC - in response to Message 1611.  

The first two of my long running WUs I listed yesterday are down. Unfortunately, it found nothing.
# Inspected 2731542253 polynomials.
# Num Polys passing PolDisc test = 0 (0%).
# Num Polys passing irreducibility test = 0 (0%).
# Num Polys passing field disc test = 0 (0%).

But I've reconized another problem regarding Boinc credits with these WUs.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168378
ran for almost a week and scored 5,745.30 credits

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168357
ran for 4 days and 7 hours, scoring 5,745.30 credits too

Shouldn't there be a difference between these two because of the 2 1/2 day longer running time? I assume that these WUs reach an upper limit in the credit calculation process.



Finding no fields is ok - some regions of the search space contain no fields. This is the norm for the regular decics app. The bounded app on the other hand will usually find fields; this is especially true for the current subfield under test.

Regarding the credits, I think the problem might be the credit cap. This was implemented a while back to thwart "cheaters" who find ways to artificially increase their run times. Let me see what I can do about the cap.
ID: 1613 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1614 - Posted: 25 Mar 2016, 23:47:35 UTC - in response to Message 1611.  

The first two of my long running WUs I listed yesterday are down. Unfortunately, it found nothing.
# Inspected 2731542253 polynomials.
# Num Polys passing PolDisc test = 0 (0%).
# Num Polys passing irreducibility test = 0 (0%).
# Num Polys passing field disc test = 0 (0%).

But I've reconized another problem regarding Boinc credits with these WUs.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168378
ran for almost a week and scored 5,745.30 credits

http://numberfields.asu.edu/NumberFields/result.php?resultid=16168357
ran for 4 days and 7 hours, scoring 5,745.30 credits too

Shouldn't there be a difference between these two because of the 2 1/2 day longer running time? I assume that these WUs reach an upper limit in the credit calculation process.


So the problem was the cap. I temporarily increased the cap until run times return to normal.

I also updated your credits to what they should have been. Let me know if there are any others.
ID: 1614 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1615 - Posted: 25 Mar 2016, 23:50:41 UTC - in response to Message 1612.  

I also have seen this as of today. One WU consumed 373,000 CPU seconds and another 184,000 seconds, but both were granted 4,069 credits.

http://numberfields.asu.edu/NumberFields/result.php?resultid=16170600
http://numberfields.asu.edu/NumberFields/result.php?resultid=16169189

As long as I'm here, let me compliment the project. This project has a very good level of communication and friendly responsiveness from the administrators, and I especially appreciate the batch status page, as I enjoy keeping track of the progress. Some projects are black holes that consume all the CPU you give them with no sense of progress. So, congratulations to this crew for providing that.


I also updated your credits to what they should have been (the 2nd task was essentially at the cap, so no change there).

And thanks for the compliment!
ID: 1615 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1616 - Posted: 26 Mar 2016, 10:15:35 UTC

Some projects are black holes that consume all the CPU you give them with no sense of progress.

That's true for most of the projects. Aside a good progress indicator (which virtually stands still at large WU batches) I like to know if I found something important. That's why I'm inspecting WU output files from extraordinary WUs or when I reconize an unusual file size.

On Primegrid you have a list of all primes you found. I don't know how many fields or "important polys" are found during the process or within a normal day, but if they are very rare such a list (or a counter when not that rare) will be nice here too.

Don't care that much about cheaters. If they need more credits than others for compensating their bad live, they won't stop even if there is an upper limit. This limit gets worked out then maxed out without beeing reconized by the script.
My approach to counter this would be calculating how much polys where tested over time and comparing this against processor capabilities. Even I won't grant credits based on benchmark/time relations, but for tested polys. This will give the same amount of credits for the same amount of work regardless of which processor has finished the WU or how good or bad the benchmark results have been.
ID: 1616 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1617 - Posted: 26 Mar 2016, 13:30:13 UTC

The tasks you listed as "heavy" on my i7 machine have both started.
While #16197688 looks not this much disturbing for now (47.463% after 92:12:00), #16374076 could provide some fun. It's hanging around at 0.038% after 22:36:00, resulting in an estimated finishing time in a couple of years. Well, let's see. My plan is to let them run, hoping the max_time and max_ops values are set high enough to not get the WUs killed by the Boinc Manager. Fortunately the machine is stable and really fast at NumberFiels and both tasks are on the same machine. I should be able to complete these WUs.
ID: 1617 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 28 Oct 11
Posts: 179
Credit: 220,401,702
RAC: 128,391
Message 1618 - Posted: 26 Mar 2016, 23:41:43 UTC - in response to Message 1608.  

I have been monitoring these and there are only 8 left. When someone finishes one, I alert the other user with the same WU and give them manual credit for their trouble.

Looks like you might be down to 7 - my copy of WU 12404860 is back, after 46 days.

Thanks for your email the other day: I did abort the spare copy I was running as you suggested. But the email address you used doesn't seem to be accepting replies - it bounced with "Mail server for "mimas.la.asu.edu" unreachable for too long".

So now I'm down to one - waiting to see which one of us on WU 12420121 finishes first.
ID: 1618 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1619 - Posted: 27 Mar 2016, 8:13:45 UTC

In this case I want to abort #16197688. Or do you want to double-check it?
Just doing such a WU for fun doesn't seem efficient to me.
ID: 1619 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1620 - Posted: 27 Mar 2016, 17:37:38 UTC - in response to Message 1619.  

In this case I want to abort #16197688. Or do you want to double-check it?
Just doing such a WU for fun doesn't seem efficient to me.


Yes, go ahead and abort that one. I will grant you the canonical credit for your trouble. Thanks!
ID: 1620 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1621 - Posted: 27 Mar 2016, 17:57:37 UTC - in response to Message 1618.  


Thanks for your email the other day: I did abort the spare copy I was running as you suggested. But the email address you used doesn't seem to be accepting replies - it bounced with "Mail server for "mimas.la.asu.edu" unreachable for too long".


Due to the war on SPAM, the ASU IT department uses some really strict mail policies. In fact, I don't think mimas even has a mail server running. It was a pain just to get private messaging working - I can't remember exactly how I did that but as far as I know it works (at least I can send/receive pms).
ID: 1621 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1622 - Posted: 27 Mar 2016, 18:02:33 UTC

Okay thank you. But let me finish the other one!
ID: 1622 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1623 - Posted: 27 Mar 2016, 18:12:15 UTC - in response to Message 1616.  

Some projects are black holes that consume all the CPU you give them with no sense of progress.

That's true for most of the projects. Aside a good progress indicator (which virtually stands still at large WU batches) I like to know if I found something important. That's why I'm inspecting WU output files from extraordinary WUs or when I reconize an unusual file size.

On Primegrid you have a list of all primes you found. I don't know how many fields or "important polys" are found during the process or within a normal day, but if they are very rare such a list (or a counter when not that rare) will be nice here too.

Don't care that much about cheaters. If they need more credits than others for compensating their bad live, they won't stop even if there is an upper limit. This limit gets worked out then maxed out without beeing reconized by the script.
My approach to counter this would be calculating how much polys where tested over time and comparing this against processor capabilities. Even I won't grant credits based on benchmark/time relations, but for tested polys. This will give the same amount of credits for the same amount of work regardless of which processor has finished the WU or how good or bad the benchmark results have been.


That's an interesting idea for computing credits. I think the main obstacle to doing that is that it doesn't play well with the built in BOINC crediting mechanisms, so I would have to modify a bunch of code to make it work. Then of course the cheaters will find ways to modify the output scripts to make it look like they tested more polynomials than they really did. Finally, the number of tested polynomials is not necessarily a good measure of how many cpu cycles the host donated; some may find that unfair.
ID: 1623 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 1318
Credit: 403,778,758
RAC: 288,359
Message 1624 - Posted: 27 Mar 2016, 18:13:17 UTC - in response to Message 1622.  

Okay thank you. But let me finish the other one!


Please do!
ID: 1624 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dj Ninja

Send message
Joined: 23 Feb 13
Posts: 29
Credit: 21,480,710
RAC: 0
Message 1625 - Posted: 28 Mar 2016, 11:01:15 UTC

ID: 1625 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Qsqrt421_DS3x8 15+ hour running time?


Main page · Your account · Message boards


Copyright © 2024 Arizona State University