Subfield 5 almost complete

Message boards : News : Subfield 5 almost complete
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2464 - Posted: 16 Jun 2019, 16:38:42 UTC

As you may have noticed, subfield 5 is nearing completion. In the next few hours the last of the work units will be sent out. Of course it will still take ~2weeks for the final results to trickle in before it's officially complete.

This is a huge milestone! This subfield was originally estimated to take over a year to complete. Due to the new optimized apps (including GPU apps), this was completed in just several months.

We will be moving on to subfield 4. But first we will make a short detour and finish off subfield 6 DS7. Don't let the ~2.5mil work units scare you. These were generated for the old apps, and would have taken about 2 hours a pop, but with the newer apps they should be about 10x faster. That means we should blow through about 350k work units per day. If this turns out to be too much of a strain on the server, then we will jump straight to subfield 4 (and run sf6 DS7 in parallel).

Thanks everyone for your contributions! We couldn't have done this without our volunteers.
ID: 2464 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Vitaly

Send message
Joined: 5 Jan 13
Posts: 30
Credit: 5,712,172
RAC: 135
Message 2468 - Posted: 18 Jun 2019, 19:50:40 UTC - in response to Message 2464.  
Last modified: 18 Jun 2019, 19:51:12 UTC

Almost all SoB projects use two different computers to calculate a WU (For example, Primegrid, yoyo etc).
Why do they do this? Because it looks like wasting of time.

Recently I found out that because of QUANTUM EFFECTS tipical user computer may commit an error even if the source code is absolutely correct and user does not attempt to cheat. The longer task the more probability to commit an error by a computer.

For example, a particle with high energy from the Sun or deep space may hit a CPU core while it is calculating a task.

For example, I also take part in SoB project:

https://www.primegrid.com/stats_sob_llr.php

Their tasks are quite long (up to 24 days). My computer is working continuously and some of my SoB tasks are calculated incorrectly because of unknown reason.

What do you think about this?
ID: 2468 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Aurel
Avatar

Send message
Joined: 25 Feb 13
Posts: 211
Credit: 8,816,142
RAC: 1,318
Message 2469 - Posted: 18 Jun 2019, 20:14:06 UTC - in response to Message 2464.  

As you may have noticed, subfield 5 is nearing completion. In the next few hours the last of the work units will be sent out. Of course it will still take ~2weeks for the final results to trickle in before it's officially complete.

This is a huge milestone! This subfield was originally estimated to take over a year to complete. Due to the new optimized apps (including GPU apps), this was completed in just several months.

We will be moving on to subfield 4. But first we will make a short detour and finish off subfield 6 DS7. Don't let the ~2.5mil work units scare you. These were generated for the old apps, and would have taken about 2 hours a pop, but with the newer apps they should be about 10x faster. That means we should blow through about 350k work units per day. If this turns out to be too much of a strain on the server, then we will jump straight to subfield 4 (and run sf6 DS7 in parallel).

Thanks everyone for your contributions! We couldn't have done this without our volunteers.



Last 24h we finished 225K workunits; most of course from SF6. :)
I expect to have slight larger runtimes for SF4 and SF5, is that correct?
ID: 2469 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2470 - Posted: 18 Jun 2019, 21:16:11 UTC - in response to Message 2468.  

Almost all SoB projects use two different computers to calculate a WU (For example, Primegrid, yoyo etc).
Why do they do this? Because it looks like wasting of time.

Recently I found out that because of QUANTUM EFFECTS tipical user computer may commit an error even if the source code is absolutely correct and user does not attempt to cheat. The longer task the more probability to commit an error by a computer.

For example, a particle with high energy from the Sun or deep space may hit a CPU core while it is calculating a task.

For example, I also take part in SoB project:

https://www.primegrid.com/stats_sob_llr.php

Their tasks are quite long (up to 24 days). My computer is working continuously and some of my SoB tasks are calculated incorrectly because of unknown reason.

What do you think about this?


I think this is off topic. Maybe you should start a new thread?

But to answer your question, I think the probability of such things are relatively low in a typical desktop PC. Also, don't the high energy particles you mention actually damage the CPU, rendering it bad (or degraded) for all future tasks? I know they use rad hard components in space applications because of this, but I was under the impression that it was a non-issue for typical systems on the earth's surface.
ID: 2470 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2471 - Posted: 18 Jun 2019, 21:18:58 UTC - in response to Message 2469.  

As you may have noticed, subfield 5 is nearing completion. In the next few hours the last of the work units will be sent out. Of course it will still take ~2weeks for the final results to trickle in before it's officially complete.

This is a huge milestone! This subfield was originally estimated to take over a year to complete. Due to the new optimized apps (including GPU apps), this was completed in just several months.

We will be moving on to subfield 4. But first we will make a short detour and finish off subfield 6 DS7. Don't let the ~2.5mil work units scare you. These were generated for the old apps, and would have taken about 2 hours a pop, but with the newer apps they should be about 10x faster. That means we should blow through about 350k work units per day. If this turns out to be too much of a strain on the server, then we will jump straight to subfield 4 (and run sf6 DS7 in parallel).

Thanks everyone for your contributions! We couldn't have done this without our volunteers.



Last 24h we finished 225K workunits; most of course from SF6. :)
I expect to have slight larger runtimes for SF4 and SF5, is that correct?


Yes, everything new that I generate will have longer runtimes (I try to target ~2hours per WU). Most of the previously generated faster WUs are in sf6.
ID: 2471 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2477 - Posted: 26 Jun 2019, 17:46:30 UTC - in response to Message 2464.  

We will be moving on to subfield 4. But first we will make a short detour and finish off subfield 6 DS7. Don't let the ~2.5mil work units scare you. These were generated for the old apps, and would have taken about 2 hours a pop, but with the newer apps they should be about 10x faster. That means we should blow through about 350k work units per day. If this turns out to be too much of a strain on the server, then we will jump straight to subfield 4 (and run sf6 DS7 in parallel).


sf6 DS7 is coming to the end. The server has been handling the extra load very well, so I think we will stay on this detour a little longer and finish off more of the faster sf6 tasks. This will give us more bang for our buck (i.e. more fields per unit runtime) and will also clear out the secondary queues.
ID: 2477 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Aurel
Avatar

Send message
Joined: 25 Feb 13
Posts: 211
Credit: 8,816,142
RAC: 1,318
Message 2479 - Posted: 30 Jun 2019, 0:55:05 UTC - in response to Message 2477.  

An other question about runtimes. As DS increases, will the runtimes increase a lil bit aswell; or are they stable and "only" the # of WU´s increases?

Also. I am noticing the amount of decic fields found increases, can you already say how much fields we found so far in SF6?
ID: 2479 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2480 - Posted: 30 Jun 2019, 3:58:47 UTC - in response to Message 2479.  

An other question about runtimes. As DS increases, will the runtimes increase a lil bit aswell; or are they stable and "only" the # of WU´s increases?

Also. I am noticing the amount of decic fields found increases, can you already say how much fields we found so far in SF6?


It should stay about the same as DS increases, but it is based on a noisy estimate, so it could go up or down, hopefully by a small amount.

In case you are wondering, here is how I determine the number of WUs in a batch. First I use the total runtime (summed over all hosts) of a previous batch to estimate the time of the next batch. For example, say I estimate the total time will be 2 million hours - if I want each task to be 2 hours, then that means I will need 1 million tasks. The search is broken up over congruence vectors (CVs), and I break them up into equal sized pieces which will perturb the time even more. To continue the example, say there are 4.4 million CVs - to have equal tasks of 4 CVs each, I would get 1.1 million tasks, which would yield tasks that were slightly faster than the 2 hour target.

Regarding your other question, so far we have found about 100 fields (up through DS6). Recall, the search algorithm finds "polynomial representatives" for the fields, and the fields have many representatives. So far in sf6, more than 10000 representatives have been found (this is the field count that you refer to).
ID: 2480 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2489 - Posted: 13 Jul 2019, 15:49:00 UTC - in response to Message 2477.  

Just a quick recap.

Subfield 5 is now officially complete. The fields can be found here and have also been uploaded to the official database.

We have finished the detour through the lower levels of subfield 6 and are now going back to finish off subfield 4.
ID: 2489 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Aurel
Avatar

Send message
Joined: 25 Feb 13
Posts: 211
Credit: 8,816,142
RAC: 1,318
Message 2490 - Posted: 13 Jul 2019, 22:23:03 UTC - in response to Message 2489.  

Neat! I saw you also started to deliver some sf7 tasks; hope thats not all from sf7. :D
ID: 2490 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2492 - Posted: 13 Jul 2019, 23:06:45 UTC - in response to Message 2490.  

Neat! I saw you also started to deliver some sf7 tasks; hope thats not all from sf7. :D


No, but just small batches for now.
ID: 2492 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Vincenzo

Send message
Joined: 7 Jun 19
Posts: 2
Credit: 134,120
RAC: 1,973
Message 2493 - Posted: 14 Jul 2019, 15:11:10 UTC

How much is missing at the end of the project?
ID: 2493 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2494 - Posted: 14 Jul 2019, 16:37:14 UTC - in response to Message 2493.  

How much is missing at the end of the project?


I'm not sure what you are asking. If you are asking how many rows are missing from the sf7 batch status table, then that can be determined from here.
ID: 2494 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Vincenzo

Send message
Joined: 7 Jun 19
Posts: 2
Credit: 134,120
RAC: 1,973
Message 2495 - Posted: 14 Jul 2019, 18:06:01 UTC

Thank you!!An other question...What is the difference between the Cpu's WU and Gpu's WU?
ID: 2495 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 939
Credit: 100,383,491
RAC: 58,474
Message 2497 - Posted: 14 Jul 2019, 19:05:20 UTC - in response to Message 2495.  

Thank you!!An other question...What is the difference between the Cpu's WU and Gpu's WU?


The apps operate on the same WUs. So you should notice the GPU app running faster than the CPU app.
ID: 2497 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : News : Subfield 5 almost complete


Main page · Your account · Message boards


Copyright © 2019 Arizona State University