Data Export Tool, For the data geeks
|
Zephyr Posted Sep 21, 2010, 1:01 am |
So I'm a data geek, and I would like to be able to track my gang's data. but all that manual re-typing is a pain. I would like an ability to export the data about my gang into a file I can upload into Excel or some other spreadsheeting software, so I can better track the growth in my gangers' skills and stats. Would this be difficult to implement? | ||||
|
Marrkos Posted Sep 21, 2010, 1:29 am |
Long ago, in the days of yore.. | ||||
|
Zephyr Posted Sep 21, 2010, 1:48 am |
You know, before i created this topic, I searched on "Excel," "spreadsheet" and "export," and got zero hits. Argh.
so anyway... did anything come of this thread you mention? |
||||
|
Marrkos Posted Sep 21, 2010, 1:55 am |
Nope.
I assume Sam put it on his list, but it probably got bumped down pretty quick. |
||||
|
*goat starer* Posted Sep 21, 2010, 8:28 am |
he filed it in the special round 'In Tray' under his desk... the same one that all my bug reports go into 
|
||||
|
*sam* Posted Sep 21, 2010, 8:29 am |
I have actually written some data export functions, for nbk_redspy who was working on a Helper app. that he was going to make available..
He seems to have stalled in this development however.. lemme see what I can find.. |
||||
|
*sam* Posted Sep 21, 2010, 8:42 am |
LOL, good one ;-) It's actually a big black binliner, goat. I used to joke with my students, telling them to file their assignments in the bin in the corner... before I realised this was politically incorrect to say that... er... I mean before I realised how important it was to read them. |
||||
|
*sam* Posted Sep 21, 2010, 9:28 am |
OK.. new option under the "Characters" menu - check it out!
(You need to refresh the DW website if you don't see a new option there under the (by town) option..) |
||||
|
Zephyr Posted Sep 21, 2010, 10:12 am |
Awesome! First time I tried it, it crashed my browser. But second time, it exported properly to a spreadsheet. Though it dropped one long, comma-delimited line at a time. Easy solution, though. ctrl-a, ctrl-c, open notepad, paste, save as .txt file; then open new spreadsheet in excel, go to data --> import data --> from file, choose the .txt file, choose 'delimited,' on next screen check the 'comma' box, click ok... boom, done. A beautiful data tracking spreadsheet.
Piece of pie. I do this kind of thing in my day job all the time. I can't wait to do a statistical analysis on my gangers' skill and stat growths. Immediate use: identify the lamest individual in the gang so I know who to fire. Thank you very much Sam (bows). |
||||
|
*sam* Posted Sep 21, 2010, 10:31 am |
You're welcome :-)
It probably depends on your version of Excel/Windows.. it launches fine into a properly parsed file, for me.. |
||||
|
lordbam Posted Sep 21, 2010, 11:02 am |
or you could download openoffice which does it correctly from the start. |
||||
|
*Tango* Posted Sep 21, 2010, 11:41 am |
Nice! Thanks Sam! |
||||
|
kometen Posted Sep 21, 2010, 2:31 pm |
ooh, nifty | ||||
|
*Dark Tempest* Posted Sep 21, 2010, 3:08 pm |
I was working with nbk_redspy on that program of his, it tracked skills gains over time and was very useful.
It is still a bit buggy but I know he still wants to work on it if he gets time. |
||||
|
*sam* Posted Sep 21, 2010, 3:14 pm |
Yep, no worries :-) I was talking to him not so long ago.. It just occurred to me that what I'd done could already be useful as a .csv exporter.. |
||||
|
d0dger Posted Sep 21, 2010, 8:58 pm |
I'm assuming the general health rating not coming through was intentional and not an oversight? Mybae because this export gives hard numbers and you only want that displayed in the range categories? | ||||
|
nbk_redspy Posted Sep 22, 2010, 1:03 am |
*Sam* was kind enough to create a lot of exports for my helper app. Unfortunately I've been slammed at work so it has been stalled a bit. 
dark_tempest was kind enough to email me to give me a bump so I'll fix the current issue and post a link tonight. Edit: Posted http://www.dark-wind.com/forums2/index.php?a=topic&t=15094 |
||||
|
*sam* Posted Sep 22, 2010, 7:53 am |
Thanks nbk. No worries with the helper app.. when it's ready, it's ready! .. I know it's a fairly complex bit of work.. I'm pleased that some of the export work I did for it has found another use. | ||||
|
*sam* Posted Sep 22, 2010, 7:54 am |
Yeah. I *could* turn it into a set of integers of course (5=excellent, 4=good, etc.) |
||||
|
d0dger Posted Sep 22, 2010, 12:28 pm |
Kind of what I was thinking... it'd be a nice addition, if it's simple enough to add. |
||||
|
Alocalypse Posted Sep 23, 2010, 6:19 pm |
This is pretty cool, but is there any chance of getting the data dumps as JSON too for fancy javascript widgetry?
It should be trivial to do in php with json_encode. Sample code: Code: 1 2 3 4 5 6 7 8 9 10
$json = json_encode($TheArrayWithTheData); //the callback stuff is necessary for cross site javascript json requests if(isset($_GET['callback'])) { echo $_GET['callback'] . '(' . $json . ')'; } else { echo $json; } |
||||
|
*sam* Posted Sep 24, 2010, 11:05 am |
Anyone using this data access feature: don't keep querying for static data (e.g. weapon types data) where you could preferably store it locally, for example. Thanks! | ||||
|
Marrkos Posted Sep 24, 2010, 1:58 pm |
Are there other functions? The only one I've seen is dumpCharacters.php, with a forexcel=1 argument. |
||||
|
Alocalypse Posted Sep 24, 2010, 2:11 pm |
Yeah, as nbk_redspy's tool reveals there's others, but I haven't gotten around to doing anything with those myself and I'll leave it up to Sam to post the exact specs. |