IRC logs of #boinc for Monday, 2010-12-13

00:19 <efc> Now what could you want with that..

00:23 <PovAddict> efc: sequentially reading 65GB of data is much faster if it can fit in RAM all at once

00:30 <efc> Have to read it a lot of times?

00:32 <PovAddict> yep

00:32 <PovAddict> convert 65GB of data, look at results, tweak script, run conversion again

00:33 <PovAddict> annoying when you have to wait two hours between tweaks... it's like I went back two or three decades in time

00:33 <PovAddict> where you had to get code right with little testing, then wait in line for computer time, and pick up the results the next day

00:34 <efc> Just serially streaming, an SSD ought to be able to keep up

00:34 <PovAddict> I think there's some nasty interleaving of I/O and CPU usage...

00:35 <efc> Definitely would want DMA on

00:35 <PovAddict> if you have a giant file, and you read a chunk, process it, read another chunk, etc. either I/O or CPU (whichever is the bottleneck) would be pegged at 100%, because the kernel would read some data in advance, and it'd be already cached by the time you read next chunk

00:35 <PovAddict> right?

00:37 <efc> yes, and I'd expect it to be CPU, depending on how much processing there is

00:38 <PovAddict> however, here it's 3 million tiny files adding up to 65GB, so the OS can't do any automatic readahead!

00:38 <efc> Oh. Now thats bad. But you could help it by doing some non-blocking read aheads.

00:38 <PovAddict> which means CPU and I/O usage are alternated, not parallel

00:38 <PovAddict> each "read chunk" has to hit the disk and meanwhile the CPU is idle, then while processing, the disk is idle

00:39 <PovAddict> I got the process to speed up a bit by manually running "cat db/1???? > /dev/null" then again with 2???? etc. in another shell

00:39 <PovAddict> indeed I should code some async readahead into the process itself

00:41 <efc> Can't cat the whole mess together ahead of time?

00:41 <PovAddict> you mean to let the system's readahead take care of it?

00:41 <PovAddict> put it all in a single file?

00:46 <efc> Yes

00:47 <PovAddict> it's a SVN repository; I'd have to hack the libsvn_ra_local library to read a packed file

00:47 <PovAddict> hmm or maybe I could use some userspace filesystem thing...

00:48 <efc> I see, just an idea.

00:49 <efc> Dunno if there's a way to memory map all the files into the cat'd one then map that back to a file.

01:46 *** Burninate has left #boinc

03:12 *** synapt has quit IRC

03:24 *** Tank_Master has quit IRC

04:04 *** Tank_Master has joined #boinc

04:32 *** synapt has joined #boinc

05:00 *** ntat has joined #boinc

06:12 <wdsmia> &wx 50319

06:12 <Romulus> wdsmia: Temperature: 1.0F / -17.2C | Humidity: 74% | Pressure: 30.42in / 1030.0hPa (Falling) | Conditions: Partly Cloudy | Wind Direction: WNW | Wind Speed: 1.2mph / 1.9km/h ; Today - Partly sunny. Very cold. High 5 to 10 above. Northwest wind 5 to 10 mph. Lowest wind chill readings around 15 below in the morning.; Tonight - Mostly cloudy. Very cold. Low zero to 5 below. Northeast wind near 5 mph (1 more message)

06:12 <wdsmia> &more

06:12 <Romulus> wdsmia: shifting to the east after midnight.; Tuesday - Partly sunny. High 15 to 20. Southeast wind near 10 mph.; Wind Chill Advisory for Polk County in effect until 9:00 AM CST on December 13, 2010;

08:28 *** wdsmia_w has joined #boinc

08:54 *** licensed has quit IRC

09:04 *** licensed has joined #boinc

09:30 <efc> Your weather, it stinks

09:30 <efc> &wx 31088

09:30 <Romulus> efc: Temperature: 28F / -2C | Humidity: 51% | Pressure: 29.91in / 1013hPa (Rising) | Conditions: Partly Cloudy | Wind Direction: NW | Wind Speed: 26mph / 43km/h ; Today - Mostly sunny. Windy. Highs in the upper 30s. Northwest winds 15 to 25 mph.; Tonight - Clear. Lows around 17. Northwest winds 5 to 15 mph. Wind chill readings around 10.; Tuesday - Sunny. Highs in the upper 30s. Northwest winds 10 (1 more message)

09:31 <efc> &more

09:31 <Romulus> efc: to 15 mph. Wind chill readings around 5 above zero.; Wind Advisory for Houston County in effect until 7:00 PM EST on December 13, 2010;

09:31 *** efc has quit IRC

09:33 *** ntat has quit IRC

10:21 *** ntat has joined #boinc

10:47 <hawmps> geeezzz..

10:48 <hawmps> friggin deep freeze.

10:51 *** ntat has quit IRC

10:52 *** yoyo[RKN] has joined #boinc

10:53 *** yoyo[RKN] has quit IRC

10:55 *** yoyo[RKN] has joined #boinc

11:13 *** hawmps has quit IRC

11:17 *** hawmps has joined #boinc

11:17 *** anthony.freenode.net sets mode: +o hawmps

11:18 *** synapt has quit IRC

11:22 *** yoyo[RKN] has quit IRC

11:25 *** synapt has joined #boinc

11:30 *** ntat has joined #boinc

12:00 *** yoyo[RKN] has joined #boinc

12:23 *** rmayorga has quit IRC

12:34 *** rmayorga has joined #boinc

12:34 *** rmayorga has joined #boinc

12:40 *** PovAddict has quit IRC

12:56 *** Tank_Master has quit IRC

12:59 *** Tank_Master has joined #boinc

13:04 *** synapt has quit IRC

13:14 *** Muligan has joined #boinc

13:14 *** Muligan is now known as Muli

13:14 *** Muli is now known as MuliGB

13:15 <MuliGB> anybody familiar with Untangle?

13:16 <MuliGB> i was looking at possibly deploying boinc on a number of machines I have running untangle

13:17 *** PovAddict has joined #boinc

13:17 *** synapt has joined #boinc

13:25 <hawmps> not one I'm familiar with..

13:26 <PovAddict> MuliGB: firewall?

13:27 <MuliGB> PovAddict, yea, it runs on debian 'lenny'

13:52 *** MuliGB has quit IRC

13:57 *** Muligan has joined #boinc

14:26 *** DerMeister has joined #boinc

14:40 *** Aeternus has joined #boinc

14:40 *** DerMeister has quit IRC

14:40 *** DerMeister has joined #boinc

14:49 *** Aeternus has quit IRC

15:05 *** Marcofe has joined #boinc

15:11 *** synapt has quit IRC

15:11 *** synapt has joined #boinc

15:27 *** Marcofe has quit IRC

15:29 *** Aeternus has joined #boinc

16:14 *** ntat has left #boinc

16:31 *** yoyo[RKN] has quit IRC

16:31 *** _Danilo_ has joined #boinc

16:31 *** _Danilo_ has quit IRC

16:31 *** _Danilo_ has joined #boinc

16:37 *** Aeternus has quit IRC

16:49 *** wdsmia_w has quit IRC

16:53 *** whynot has joined #boinc

17:21 *** DerMeister has quit IRC

17:22 *** Aeternus has joined #boinc

17:32 *** quail has quit IRC

18:24 *** Aeternus has quit IRC

18:27 *** Aeternus has joined #boinc

18:52 <Muligan> does boinc not run as a service?

18:52 <PovAddict> you mean a Windows service?

18:52 <PovAddict> yes it does

18:53 <PovAddict> but I think it's now disabled by default because services can't access the GPU

18:55 <Muligan> i installed on a handful of dc7800 machines

18:55 <Muligan> and i guess with that, they've been disabled all day

18:55 <Muligan> know what the service name would be?

18:55 <PovAddict> just "BOINC"

18:56 <Muligan> yes, doesn't look like it gt installed

18:57 <PovAddict> the installer asks if you want to install as a service or not

18:57 <PovAddict> with some unclear wording though

18:57 <Muligan> by default, i take it it's not

18:57 <PovAddict> it's not because services can't access the GPU

18:58 <PovAddict> so in the name of GPUs, they disabled service installation by default

18:58 <Muligan> yea, these really don't have a gpu to work from

18:58 <Muligan> work with rather

19:01 *** whynot has quit IRC

19:22 *** Romulus` has joined #boinc

19:22 *** Romulus has quit IRC

19:22 *** Romulus` is now known as Romulus

19:23 *** xcamel_ has joined #boinc

19:23 *** xcamel_ has quit IRC

19:23 *** xcamel_ has joined #boinc

19:23 *** ChanServ sets mode: +o xcamel_

19:25 *** PieSpyRom has quit IRC

19:25 *** xcamel has quit IRC

19:26 *** PieSpyRom has joined #boinc

19:33 *** _Danilo_ has quit IRC

19:50 *** zombie67 has joined #boinc

20:08 *** efc has joined #boinc

20:10 <efc> &wx 31088

20:10 <Romulus> efc: Temperature: 27F / -3C | Humidity: 51% | Pressure: 30.05in / 1018hPa (Rising) | Conditions: Clear | Wind Direction: WNW | Wind Speed: 17mph / 28km/h ; Tonight - Clear. Lows around 17. Northwest winds 5 to 15 mph. Wind chill readings around 5 above zero.; Tuesday - Sunny. Highs in the upper 30s. Northwest winds 10 to 15 mph. Wind chill readings around 5 above zero.; Tuesday Night - Partly (1 more message)

20:10 <efc> &more

20:10 <Romulus> efc: cloudy in the evening then becoming mostly cloudy. Lows around 20. Light and variable winds.;

21:03 *** zombie67 has quit IRC

21:14 *** zombie67 has joined #boinc

21:26 *** zombie67 has quit IRC

22:25 *** zombie67 has joined #boinc

22:41 <PovAddict> &wx hell

22:41 <Romulus> PovAddict: Temperature: 8.0F / -13.3C | Humidity: 83% | Pressure: 30.07in / 1018.2hPa (Steady) | Conditions: Clear | Wind Direction: NW | Wind Speed: 13.0mph / 20.9km/h ; Rest of Tonight - Mostly clear. Areas of blowing and drifting snow. Lows 1 below to 5 above...with wind chills around 15 below. Northwest winds 10 to 20 mph.; Tuesday - Mostly sunny and brisk. Highs 17 to 21. Northwest winds 15 to (1 more message)

22:48 *** quail has joined #boinc

23:40 *** Docteh has joined #boinc

23:51 *** quail has quit IRC

23:52 *** Docteh has quit IRC

23:52 *** hawmps has quit IRC

23:52 *** Tank_Master has quit IRC

23:52 *** CoderForLife has quit IRC

23:52 *** Turf has quit IRC

23:52 *** GaelicGrime has quit IRC

23:52 *** zombie67 has quit IRC

23:52 *** Docteh_ has quit IRC

23:52 *** synapt has quit IRC

23:52 *** Pikel has quit IRC

23:53 *** Tank_Master has joined #boinc

23:54 *** synapt has joined #boinc

23:54 *** Docteh has joined #boinc

23:54 *** hawmps has joined #boinc

23:54 *** anthony.freenode.net sets mode: +o hawmps

23:55 *** zombie_67 has joined #boinc

23:55 *** Turf has joined #boinc

23:55 *** GaelicGrime has joined #boinc

23:55 *** CoderForLife has joined #boinc

23:55 *** anthony.freenode.net sets mode: +o CoderForLife

23:55 *** Pikel has joined #boinc

23:57 *** Pikel has quit IRC

23:57 *** CoderForLife has quit IRC

23:57 *** zombie_67 has quit IRC

23:57 *** Turf has quit IRC

23:57 *** GaelicGrime has quit IRC

23:57 *** Docteh has quit IRC

23:57 *** hawmps has quit IRC

23:57 *** synapt has quit IRC

23:57 *** Tank_Master has quit IRC

23:58 *** Pikel has joined #boinc

23:58 *** CoderForLife has joined #boinc

23:58 *** GaelicGrime has joined #boinc

23:58 *** Turf has joined #boinc

23:58 *** zombie_67 has joined #boinc

23:58 *** hawmps has joined #boinc

23:58 *** Docteh has joined #boinc

23:58 *** synapt has joined #boinc

23:58 *** Tank_Master has joined #boinc

23:58 *** anthony.freenode.net sets mode: +oo CoderForLife hawmps

Generated by irclog2html.py 2.4 by Marius Gedminas - find it at mg.pov.lt!