Very few jobs.
log in

Advanced search

Message boards : Number crunching : Very few jobs.

Author Message
Sakhalin_Cat
Avatar
Send message
Joined: 29 Mar 16
Posts: 17
Credit: 12,203,916,332
RAC: 3,152
Message 22562 - Posted: 14 Jun 2016, 15:28:36 UTC
Last modified: 14 Jun 2016, 15:45:07 UTC

On part computers in my small datacentre installed 3*980Ti GPU and work for computation 24/7/365.
Each GPU card calculates 5 job in parallel. Before latest updates on every my computer downloaded and calculated 15 job parallel.
The calculation took 5-6 minutes time for 15 job tasks + long time for CPU tasks calculations.
Now give me a total of 5 jobs. My system was idle 70%. If I take 1 task for each GPU that would be a simple 90%.
Since the scheduler updates the task every 5 minutes, and 1 task on the GPU is considered to be only 1 minute.




It is necessary either to allow the scheduler to be updated more often. I can do script for this. Either remove the limit on the number of concurrent tasks.

I am very upset my 6*980Ti + 7*750Ti can't work with full load after your changes. I specifically bought computers for your project and donate each month 210-250$ on electricity for computers calculate Collatz project in my datacentre. Now all computer aimlessly warm air.
____________

Sakhalin_Cat
Avatar
Send message
Joined: 29 Mar 16
Posts: 17
Credit: 12,203,916,332
RAC: 3,152
Message 22565 - Posted: 14 Jun 2016, 17:13:13 UTC
Last modified: 14 Jun 2016, 17:22:44 UTC

Error sheduler for run one task per one GPU


15.06.2016 3:20:41 | Collatz Conjecture | work fetch suspended by user

Manual update project

15.06.2016 3:24:10 | Collatz Conjecture | update requested by user
15.06.2016 3:24:16 | Collatz Conjecture | Sending scheduler request: Requested by user.
15.06.2016 3:24:16 | Collatz Conjecture | Reporting 4 completed tasks
15.06.2016 3:24:16 | Collatz Conjecture | Not requesting tasks: "no new tasks" requested via Manager
15.06.2016 3:24:19 | Collatz Conjecture | Scheduler request completed

Run Project

15.06.2016 3:24:28 | Collatz Conjecture | work fetch resumed by user

Manual update 3:24:31

15.06.2016 3:24:31 | Collatz Conjecture | update requested by user
15.06.2016 3:24:34 | Collatz Conjecture | Sending scheduler request: Requested by user.
15.06.2016 3:24:34 | Collatz Conjecture | Requesting new tasks for CPU and NVIDIA GPU
15.06.2016 3:24:37 | Collatz Conjecture | Scheduler request completed: got 0 new tasks

15.06.2016 3:24:37 | Collatz Conjecture | Not sending work - last request too recent: 19 sec

Eror update - Fckd Timer 3:24:37 - 3:29:44= 5 min lost time...

15.06.2016 3:29:44 | Collatz Conjecture | Sending scheduler request: To fetch work.
15.06.2016 3:29:44 | Collatz Conjecture | Requesting new tasks for CPU and NVIDIA GPU
15.06.2016 3:29:47 | Collatz Conjecture | Scheduler request completed: got 4 new tasks
15.06.2016 3:29:49 | Collatz Conjecture | Started download of collatz_sieve_2719511585108640399360_6597069766656
15.06.2016 3:29:49 | Collatz Conjecture | Started download of collatz_sieve_2719500752720083550208_6597069766656
15.06.2016 3:29:50 | Collatz Conjecture | Finished download of collatz_sieve_2719511585108640399360_6597069766656
15.06.2016 3:29:50 | Collatz Conjecture | Finished download of collatz_sieve_2719500752720083550208_6597069766656
15.06.2016 3:29:50 | Collatz Conjecture | Started download of collatz_sieve_2719500759317153316864_6597069766656
15.06.2016 3:29:50 | Collatz Conjecture | Started download of collatz_sieve_2719510100767942901760_6597069766656

YES YES - Run Computation 3:29:50

15.06.2016 3:29:50 | Collatz Conjecture | Starting task collatz_sieve_2719500752720083550208_6597069766656_0
15.06.2016 3:29:50 | Collatz Conjecture | Starting task collatz_sieve_2719511585108640399360_6597069766656_0
15.06.2016 3:29:51 | Collatz Conjecture | Starting task collatz_sieve_2719500759317153316864_6597069766656_0
15.06.2016 3:31:44 | Collatz Conjecture | Computation for task collatz_sieve_2719511585108640399360_6597069766656_0 finished
15.06.2016 3:32:05 | Collatz Conjecture | Computation for task collatz_sieve_2719500752720083550208_6597069766656_0 finished
15.06.2016 3:32:06 | Collatz Conjecture | Computation for task collatz_sieve_2719500759317153316864_6597069766656_0 finished

Computation End - 3:31:44 - Time for Computation - 1min 50sec

15.06.2016 3:34:53 | Collatz Conjecture | Sending scheduler request: To report completed tasks.
15.06.2016 3:34:53 | Collatz Conjecture | Reporting 4 completed tasks
15.06.2016 3:34:53 | Collatz Conjecture | Requesting new tasks for CPU and NVIDIA GPU
15.06.2016 3:34:56 | Collatz Conjecture | Scheduler request completed: got 4 new tasks
15.06.2016 3:34:58 | Collatz Conjecture | Started download of collatz_sieve_2719513557632500629504_6597069766656
15.06.2016 3:34:58 | Collatz Conjecture | Started download of collatz_sieve_2719513564229570396160_6597069766656
15.06.2016 3:35:00 | Collatz Conjecture | Finished download of collatz_sieve_2719513557632500629504_6597069766656
15.06.2016 3:35:00 | Collatz Conjecture | Finished download of collatz_sieve_2719513564229570396160_6597069766656
15.06.2016 3:35:00 | Collatz Conjecture | Started download of collatz_sieve_2719513570826640162816_6597069766656
15.06.2016 3:35:00 | Collatz Conjecture | Started download of collatz_sieve_2719513577423709929472_6597069766656
15.06.2016 3:35:00 | Collatz Conjecture | Starting task collatz_sieve_2719513564229570396160_6597069766656_0
15.06.2016 3:35:00 | Collatz Conjecture | Starting task collatz_sieve_2719513557632500629504_6597069766656_0
15.06.2016 3:35:02 | Collatz Conjecture | Finished download of collatz_sieve_2719513570826640162816_6597069766656
15.06.2016 3:35:02 | Collatz Conjecture | Finished download of collatz_sieve_2719513577423709929472_6597069766656

Run Computation next JOB - 3:35:02 31:44-35:02= 3min 16sec This is= 2times for computation job... for what purpose??? for what reason???

15.06.2016 3:35:02 | Collatz Conjecture | Starting task collatz_sieve_2719513570826640162816_6597069766656_0

Run Project= 3:29:44
End Project= 3:35:02
Lost time = 35:02-29:44=5min15sec - Computation time 1min50sec= 3min25sec

Work time= 1min 50sec
WAIT time= 3min25sec for what purpose??? for what reason???

24hours =100% Work Time\ 1min25sec===== 86400sec\85sec=1016 job per day

24hors include sheduler error ===== 86400\315sec=274 job per day.



This mad update your system.
____________

Profile Slicker
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 11 Jun 09
Posts: 2525
Credit: 740,580,099
RAC: 1
Message 22566 - Posted: 14 Jun 2016, 17:57:47 UTC

I increased the number of jobs per GPU as well as the number allowed in progress and also reduced the wait time between work requests from 5 minutes to 1 minute.

Sakhalin_Cat
Avatar
Send message
Joined: 29 Mar 16
Posts: 17
Credit: 12,203,916,332
RAC: 3,152
Message 22567 - Posted: 14 Jun 2016, 18:49:47 UTC

Thank you. Everything is working fine.Your changes I noticed right away. Instantly increas power consumption on indicators of the load on the UPS. :)
____________

Sakhalin_Cat
Avatar
Send message
Joined: 29 Mar 16
Posts: 17
Credit: 12,203,916,332
RAC: 3,152
Message 22568 - Posted: 14 Jun 2016, 18:54:13 UTC


____________


Post to thread

Message boards : Number crunching : Very few jobs.


Main page · Your account · Message boards


Copyright © 2018 Jon Sonntag; All rights reserved.