Server upgrade

Message boards : News : Server upgrade
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2122 - Posted: 8 Jan 2019, 18:48:56 UTC

I just upgraded the project server, including the web code. Things appear to be working properly, but please report anything out of the ordinary. Thanks!
ID: 2122 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
BetelgeuseFive

Send message
Joined: 2 Jan 19
Posts: 3
Credit: 228,064
RAC: 540
Message 2123 - Posted: 10 Jan 2019, 16:27:51 UTC

Hello Eric,

Thanks for the update. Can you please check the stats export ? There were no updates on BoincStats the last 2 days.

Thanks,

Tom
ID: 2123 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2124 - Posted: 10 Jan 2019, 20:41:20 UTC - in response to Message 2123.  

Thanks for reporting! The problem seems to be with the db_dump executable. For some reason it is seg faulting. Until I figure out why, I popped the old version back in which seems to be working.

Hello Eric,

Thanks for the update. Can you please check the stats export ? There were no updates on BoincStats the last 2 days.

Thanks,

Tom
ID: 2124 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 28 Oct 11
Posts: 131
Credit: 107,724,081
RAC: 29,758
Message 2125 - Posted: 10 Jan 2019, 23:06:25 UTC

What exactly did you update? Can you identify the new server code version that you used?

There have been changes to the db_dump code to accommodate GDPR (European privacy legislation). It's possible - wild guess here - that additional configuration may be necessary, to accommodate (or not) user choices about revealing or withholding their private stats information.

I see you've written to the projects mailing list: I mentioned your report about the update to the development team in a conference call earlier this evening. Between them, I hope those will attract the attention of the people who know.
ID: 2125 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2126 - Posted: 11 Jan 2019, 0:41:08 UTC - in response to Message 2125.  

Hi Richard,

I did a git pull (boinc repo) to get the latest code. Did a make clean, followed by a make to build everything. Then ran the upgrade script in the tools directory, and had it upgrade everything (server, database, web).

I'm not sure how to determine the "server version". In the boinc directory, version.h says 7.15.0 and svn_version.h says server_release/1.0/1.0.0. I thought I read the latest server version was 1.0.3, so maybe I don't have the latest after all.

To make matters even more confusing, if I run "transitioner --version" it shows me the git boinc-v2 repo. Same story for the other daemons. I originally cloned the boinc repo (or thought I had), so this makes no sense.
ID: 2126 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 28 Oct 11
Posts: 131
Credit: 107,724,081
RAC: 29,758
Message 2127 - Posted: 11 Jan 2019, 9:35:06 UTC - in response to Message 2126.  

OK, I'll pass that upstream. Laurence Field of CERN (LHC@Home) is working to create a 'server stable' versioning system, and that may have been where you picked up the reference to v1.0.3 - I think that's what they're testing at the moment. v7.15.0 is the correct value for the client code contained in the master Git repo alongside the server stuff.

I'll check out the latest state of play and report back.
ID: 2127 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2128 - Posted: 11 Jan 2019, 16:20:06 UTC - in response to Message 2127.  

Ok, Thanks Richard.
ID: 2128 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2129 - Posted: 11 Jan 2019, 21:40:53 UTC - in response to Message 2127.  

So it looks like the problem was a simple one - I needed to enable the STATSEXPORT consent type (I should have paid closer attention to Richard's wild guess earlier).

The new and improved db_dump is back in place now. Just to be safe, I will continue to monitor it.
ID: 2129 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 28 Oct 11
Posts: 131
Credit: 107,724,081
RAC: 29,758
Message 2130 - Posted: 11 Jan 2019, 22:50:54 UTC

Good to hear that things are under control. I've been watching the emails passing back and forth: you're in good hands - far better than mine - so appropriate for me to keep out of the noise.
ID: 2130 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Henk Haneveld

Send message
Joined: 12 Oct 17
Posts: 2
Credit: 195,777
RAC: 260
Message 2131 - Posted: 12 Jan 2019, 9:05:04 UTC

May I suggest that you put a message on the frontpage that users need to tick the consent box in the project preferences for stats export.
ID: 2131 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2132 - Posted: 12 Jan 2019, 16:50:55 UTC - in response to Message 2131.  

May I suggest that you put a message on the frontpage that users need to tick the consent box in the project preferences for stats export.


Yes, that's a good idea. I put the old db_dump back when I realized the export files were very small due to the default consent to not export stats. I will give users a couple days to check the consent box before I put the newer db_dump back.
ID: 2132 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Matt Kowal
Avatar

Send message
Joined: 12 Oct 13
Posts: 14
Credit: 34,600,560
RAC: 18,011
Message 2140 - Posted: 24 Jan 2019, 20:44:56 UTC

Can you please check the stats export? The last update on BoincStats is from January 22nd.
Thank you!
ID: 2140 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2141 - Posted: 25 Jan 2019, 5:08:26 UTC - in response to Message 2140.  

I believe stats exporting is working on our end, at least I see the stats directory for every day and its populated with reasonable looking zip files.

So I went over to the BoincStats site and saw a message about needing to be added to a special list. I requested they add NumberFields to the list. Hopefully it wont take too long.
ID: 2141 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
BetelgeuseFive

Send message
Joined: 2 Jan 19
Posts: 3
Credit: 228,064
RAC: 540
Message 2142 - Posted: 25 Jan 2019, 6:39:22 UTC - in response to Message 2141.  

It is not just a problem with the stats export. When I look at my account page here at NumberFields@home (but also at other projects) the information for NumberFields@home in the "Projects in which you are participating list is wrong (the NumberFields@home specific data earlier on the page is correct though). In my case the data in the list is a copy from another project but definitely not the NumberFields@home data.

Can you please have a look at this too ?

Thanks,

Tom
ID: 2142 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ncoded.com

Send message
Joined: 25 Oct 18
Posts: 2
Credit: 1,004,408
RAC: 0
Message 2143 - Posted: 25 Jan 2019, 8:46:38 UTC
Last modified: 25 Jan 2019, 8:58:45 UTC

There is another issue which seems to have surfaced since the latest stat export.
There is no longer any options for Country or URL within: Account/Other_account_info
Our account has been moved from UK to International.
ID: 2143 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 28 Oct 11
Posts: 131
Credit: 107,724,081
RAC: 29,758
Message 2144 - Posted: 25 Jan 2019, 9:48:58 UTC - in response to Message 2142.  

It is not just a problem with the stats export. When I look at my account page here at NumberFields@home (but also at other projects) the information for NumberFields@home in the "Projects in which you are participating list is wrong (the NumberFields@home specific data earlier on the page is correct though). In my case the data in the list is a copy from another project but definitely not the NumberFields@home data.

Can you please have a look at this too ?

Thanks,

Tom
Likewise here. In my case, the cross-project line is copied from the immediately previous project line in alphabetical order.

I've looked at the current stats export for my account:

<user>
 <id>1969</id>
 <name>Richard Haselgrove</name>
 <create_time>1319792132</create_time>
 <total_credit>96705660.619374</total_credit>
 <expavg_credit>34201.016603</expavg_credit>
 <expavg_time>1548365625.070331</expavg_time>
 <cpid>68aa4b6077c3fe48975e530f6ad94ca5</cpid>
</user>
which looks fine, and is also displayed correctly on BOINCstats

So this looks like a processing error at netsoft online (which provides the aggregated cross-project stats for this list and the cross-project certificate). You may need to liaise with James Drews (contact details at GitHub) to work out what's going on.
ID: 2144 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2145 - Posted: 25 Jan 2019, 18:23:52 UTC - in response to Message 2143.  

There is another issue which seems to have surfaced since the latest stat export.
There is no longer any options for Country or URL within: Account/Other_account_info
Our account has been moved from UK to International.


I fixed this one.
Still looking into the other issue(s), when I find the time...
ID: 2145 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2146 - Posted: 25 Jan 2019, 21:10:17 UTC - in response to Message 2145.  

I posted on the netsoft-online forums about this issue. Just waiting to hear back now.
ID: 2146 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Eric Driver
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 8 Jul 11
Posts: 934
Credit: 98,576,733
RAC: 54,637
Message 2147 - Posted: 25 Jan 2019, 21:20:23 UTC - in response to Message 2146.  

I was just comparing the stats files between the old db_dumps and the newer ones, and the only real difference I could see was the country tag is missing in the newer dumps. I wonder if this is the root cause of the problem. My earlier fix now puts the country into the dump file, so this may also fix the problem over at netsoft-online.
ID: 2147 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ncoded.com

Send message
Joined: 25 Oct 18
Posts: 2
Credit: 1,004,408
RAC: 0
Message 2148 - Posted: 25 Jan 2019, 21:38:22 UTC - in response to Message 2147.  

Thank you Eric.
ID: 2148 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : News : Server upgrade


Main page · Your account · Message boards


Copyright © 2019 Arizona State University