2011-DataStructureNotes

From USYVL Development Wiki
Jump to navigation Jump to search

Classes of data to copy

  • static web content that does not change: images, favicons, "coming soon" files - should eventually be handled by joomla
  • previous data: Sample Input Data, Neighboring Communities, TSL data (should not be needed anymore as the TSL functionality has moved to workflow
  • generated data to cache: proximity data, location data
  • user modified data: edited xml files
  • user uploaded data: manually created PDFs, input files
  • settings - net configs, game specs, pool optimization
    • should have defaults created on first pass, allow editing/form select subsequently

More integrated configuration system

 set key value pairs: key, default value, description, category, scopes(?)
 get value from key, scope?....

Should have global settings, allow each site/(tournament? pool?) to override....

  • store settings (key->value pairs) in a db?
  • store serialized php array(s)/objects(s) in a db?
  • conf function to return a value for a key conf(key)... conf_set(key, value)...
  • possibly use YAML - JSON, XML, SDL - Spyc (PHP implementation), Symfony YAML, PHP-Syck, PECL Yaml

find io* -type d directory structure

io
    2011_B_Summer-xml-games
    input
        Location_data
        notused-maybe
        Sample_Input_data
        TSL_data
            old
    output
    schedules
        2011_B_Summer-gs
        2011_B_Summer-ip
        2011_B_Summer-is
        2011_B_Summer-si
        2011_B_Summer-ss
        2011_B_Summer-ti
        2011_B_Summer-ts
io-final
    schedules
io-media
    AlisoViejo
    Goleta
    Goleta/Goleta-2-Ventura
    Oxnard
    Ventura
io-preserve
    2010_C_Fall-xml-tourn
    2011_A_Spring-xml-games
    2011_A_Spring-xml-tourn
    2011_B_Summer-xml-tourn
    default-xml-games
io-static
    input
        Location_data
        notused-maybe
        Sample_Input_data
        TSL_data
            old
    schedules
    
#### Possible new ####   
io
    curr
    media
    web
    web-static
    web-ftped   - directory to keep track of status of files that have been ftped to server, compare files to these to decide about uploading
    cached

find listing of io

io
io/.DS_Store
io/2011_B_Summer-xml-games
io/2011_B_Summer-xml-games/Edmonds.xml
io/2011_B_Summer-xml-games/Elgin.xml
io/2011_B_Summer-xml-games/Everett.xml
io/2011_B_Summer-xml-games/Marysville.xml
io/2011_B_Summer-xml-games/Pittsburgh.xml
io/2011_B_Summer-xml-games/Snohomish.xml
io/input
io/input/.DS_Store
io/input/2011_B_Summer-addrs
io/input/2011_B_Summer-events
io/input/2011_B_Summer-games
io/input/2011_B_Summer-locations_geocodes.kml
io/input/2011_B_Summer-locations_geocodes.tab
io/input/2011_B_Summer-locations_manual.tab
io/input/2011_B_Summer-locations_zipcodes.tab
io/input/2011_B_Summer-proximity
io/input/2011_B_Summer-proximity-distances
io/input/2011_B_Summer-proximity-failures
io/input/2011_B_Summer-proximity-standalone
io/input/2011_B_Summer-sites
io/input/2011_B_Summer-teams
io/input/2011_B_Summer-tourn
io/input/2011_B_Summer-tourn_dates
io/input/2011_B_Summer-tourn_dates-sitecounts
io/input/cached-locations_geocodes.tab
io/input/CMI_tsl_2011-07-23.txt
io/input/CMI_tsl_2011-07-30.txt
io/input/CMI_tsl_2011-08-06.txt
io/input/CMI_tsl_2011-08-13.txt
io/input/GroupSeed
io/input/Location_data
io/input/Location_data/Camarillo.kmz
io/input/Location_data/El Segundo.kmz
io/input/Location_data/Goleta - meadow.kmz
io/input/Location_data/Goleta - softball field.kmz
io/input/Location_data/Lake Elsinore.kmz
io/input/Location_data/Morgan Hill.kmz
io/input/Location_data/San Jose.kmz
io/input/NC-data.ser
io/input/notused-maybe
io/input/notused-maybe/conv8
io/input/notused-maybe/orig16.csv
io/input/notused-maybe/orig8.csv
io/input/notused-maybe/TeamListAll-xml.xml
io/input/Sample_Input_data
io/input/Sample_Input_data/.DS_Store
io/input/Sample_Input_data/2007-A-Spring-ev
io/input/Sample_Input_data/2007-A-Spring-tm
io/input/Sample_Input_data/2007-C-Fall-ev
io/input/Sample_Input_data/2007-C-Fall-tm
io/input/Sample_Input_data/2008-A-Spring-ev
io/input/Sample_Input_data/2008-A-Spring-tm
io/input/Sample_Input_data/2008-B-Summer-ev
io/input/Sample_Input_data/2008-B-Summer-tm
io/input/Sample_Input_data/2008-MS-events
io/input/Sample_Input_data/2008-MS-teams
io/input/Sample_Input_data/2008_C_Fall-ev
io/input/Sample_Input_data/2008_C_Fall-events
io/input/Sample_Input_data/2008_C_Fall-events-e2
io/input/Sample_Input_data/2008_C_Fall-teams
io/input/Sample_Input_data/2008_C_Fall-tm
io/input/Sample_Input_data/2009_A_Spring-ev
io/input/Sample_Input_data/2009_A_Spring-events
io/input/Sample_Input_data/2009_A_Spring-events-nh
io/input/Sample_Input_data/2009_A_Spring-teams
io/input/Sample_Input_data/2009_A_Spring-teams-nh
io/input/Sample_Input_data/2009_A_Spring-tm
io/input/Sample_Input_data/2009_A_Spring_faked-ev
io/input/Sample_Input_data/2009_A_Spring_faked-tm
io/input/Sample_Input_data/2009_B_Summer-events
io/input/Sample_Input_data/2009_B_Summer-teams
io/input/Sample_Input_data/2009_C_Fall-events
io/input/Sample_Input_data/2009_C_Fall-teams
io/input/Sample_Input_data/2010_A_Spring-events
io/input/Sample_Input_data/2010_A_Spring-events.csv
io/input/Sample_Input_data/2010_A_Spring-teams
io/input/Sample_Input_data/2010_A_Spring-teams.csv
io/input/Sample_Input_data/2010_A_Spring-tm-short.csv
io/input/Sample_Input_data/2010_A_Spring-tm-test
io/input/Sample_Input_data/2010_B_Summer-events
io/input/Sample_Input_data/2010_B_Summer-teams
io/input/Sample_Input_data/2010_C_Fall-events
io/input/Sample_Input_data/2010_C_Fall-teams
io/input/Sample_Input_data/2011_A_Spring-events
io/input/Sample_Input_data/2011_A_Spring-teams
io/input/Sample_Input_data/2011_B_Summer-events
io/input/Sample_Input_data/2011_B_Summer-events-smtn
io/input/Sample_Input_data/2011_B_Summer-teams
io/input/Sample_Input_data/2011_B_Summer-teams-smtn
io/input/Sample_Input_data/events-2008_combined
io/input/Sample_Input_data/splittest.txt
io/input/Sample_Input_data/upload-events.txt
io/input/Sample_Input_data/upload-teams.txt
io/input/Sample_Input_data/zipcodes.db
io/input/tourn-options.txt
io/input/TSL_data
io/input/TSL_data/old
io/input/TSL_data/old/TSL_build-2008-10-04.txt
io/input/TSL_data/old/TSL_build-2008-10-11.txt
io/input/TSL_data/old/TSL_build-2008-10-18.txt
io/input/TSL_data/old/TSL_build-2008-10-25.txt
io/input/TSL_data/TSL_build-2007-05-05.txt
io/input/TSL_data/TSL_build-2007-05-12.txt
io/input/TSL_data/TSL_build-2007-05-19.txt
io/input/TSL_data/TSL_build-2007-06-02.txt
io/input/TSL_data/TSL_build-2007-10-06.txt
io/input/TSL_data/TSL_build-2007-10-13.txt
io/input/TSL_data/TSL_build-2007-10-20.txt
io/input/TSL_data/TSL_build-2007-10-27.txt
io/input/TSL_data/TSL_build-2007-11-10.txt
io/input/TSL_data/TSL_build-2008-05-10.txt
io/input/TSL_data/TSL_build-2008-05-17.txt
io/input/TSL_data/TSL_build-2008-05-31.txt
io/input/TSL_data/TSL_build-2008-10-04.txt
io/input/TSL_data/TSL_build-2008-10-11.txt
io/input/TSL_data/TSL_build-2008-10-18.txt
io/input/TSL_data/TSL_build-2008-10-25.txt
io/input/TSL_data/TSL_build-2009-04-25.txt
io/input/TSL_data/TSL_build-2009-05-02.txt
io/input/TSL_data/TSL_build-2009-05-09.txt
io/input/TSL_data/TSL_build-2009-05-16.txt
io/input/TSL_data/TSL_build-2009-05-23.txt
io/input/TSL_data/TSL_build-2009-05-30.txt
io/input/TSL_exceptions
io/input/TSL_preferred
io/input/TSL_preferred-auto
io/input/TSL_preset_2007_A_Spring
io/input/TSL_preset_2007_C_Fall
io/input/TSL_preset_2008_A_Spring
io/input/upload-events.txt
io/input/upload-teams.txt
io/input/zips.csv.gz
io/output
io/output/2011_B_Summer-games-raw
io/schedules
io/schedules/2011_B_Summer-gs
io/schedules/2011_B_Summer-gs/index.htm
io/schedules/2011_B_Summer-gs/Index.html
io/schedules/2011_B_Summer-ip
io/schedules/2011_B_Summer-ip/Edmonds.pdf
io/schedules/2011_B_Summer-ip/Elgin.pdf
io/schedules/2011_B_Summer-ip/Everett.pdf
io/schedules/2011_B_Summer-ip/index.htm
io/schedules/2011_B_Summer-ip/Index.html
io/schedules/2011_B_Summer-ip/Marysville.pdf
io/schedules/2011_B_Summer-ip/Pittsburgh.pdf
io/schedules/2011_B_Summer-ip/Snohomish.pdf
io/schedules/2011_B_Summer-is
io/schedules/2011_B_Summer-is/Edmonds.html
io/schedules/2011_B_Summer-is/Elgin.html
io/schedules/2011_B_Summer-is/Everett.html
io/schedules/2011_B_Summer-is/index.htm
io/schedules/2011_B_Summer-is/Index.html
io/schedules/2011_B_Summer-is/Marysville.html
io/schedules/2011_B_Summer-is/Pittsburgh.html
io/schedules/2011_B_Summer-is/Snohomish.html
io/schedules/2011_B_Summer-si
io/schedules/2011_B_Summer-si/index.htm
io/schedules/2011_B_Summer-si/Index.html
io/schedules/allsites.kml
io/schedules/general.css
io/schedules/gs.html
io/schedules/gs.jpg
io/schedules/index.htm
io/schedules/Index.html
io/schedules/is
io/schedules/NeighboringCommunities.html
io/schedules/NeighboringCommunitiesCMI.html
io/schedules/return.jpg
io/schedules/rules-old.pdf
io/schedules/rules.pdf
io/schedules/si.html
io/schedules/template.css
io/schedules/ti.html
io/schedules/ts.html
io/schedules/ts.jpg
io/schedules/usyvl.css
io/schedules/usyvl_bg.css
io/schedules/usyvl_site_content.css
io/schedules/usyvlbanner.jpg
io/schedules/vbsmrwb.png

find listing of io-static

io-static
io-static/.DS_Store
io-static/input
io-static/input/.DS_Store
io-static/input/cached-locations_geocodes.tab
io-static/input/GroupSeed
io-static/input/Location_data
io-static/input/Location_data/Camarillo.kmz
io-static/input/Location_data/El Segundo.kmz
io-static/input/Location_data/Goleta - meadow.kmz
io-static/input/Location_data/Goleta - softball field.kmz
io-static/input/Location_data/Lake Elsinore.kmz
io-static/input/Location_data/Morgan Hill.kmz
io-static/input/Location_data/San Jose.kmz
io-static/input/NC-data.ser
io-static/input/notused-maybe
io-static/input/notused-maybe/conv8
io-static/input/notused-maybe/orig16.csv
io-static/input/notused-maybe/orig8.csv
io-static/input/notused-maybe/TeamListAll-xml.xml
io-static/input/Sample_Input_data
io-static/input/Sample_Input_data/.DS_Store
io-static/input/Sample_Input_data/2007-A-Spring-ev
io-static/input/Sample_Input_data/2007-A-Spring-tm
io-static/input/Sample_Input_data/2007-C-Fall-ev
io-static/input/Sample_Input_data/2007-C-Fall-tm
io-static/input/Sample_Input_data/2008-A-Spring-ev
io-static/input/Sample_Input_data/2008-A-Spring-tm
io-static/input/Sample_Input_data/2008-B-Summer-ev
io-static/input/Sample_Input_data/2008-B-Summer-tm
io-static/input/Sample_Input_data/2008-MS-events
io-static/input/Sample_Input_data/2008-MS-teams
io-static/input/Sample_Input_data/2008_C_Fall-ev
io-static/input/Sample_Input_data/2008_C_Fall-events
io-static/input/Sample_Input_data/2008_C_Fall-events-e2
io-static/input/Sample_Input_data/2008_C_Fall-teams
io-static/input/Sample_Input_data/2008_C_Fall-tm
io-static/input/Sample_Input_data/2009_A_Spring-ev
io-static/input/Sample_Input_data/2009_A_Spring-events
io-static/input/Sample_Input_data/2009_A_Spring-events-nh
io-static/input/Sample_Input_data/2009_A_Spring-teams
io-static/input/Sample_Input_data/2009_A_Spring-teams-nh
io-static/input/Sample_Input_data/2009_A_Spring-tm
io-static/input/Sample_Input_data/2009_A_Spring_faked-ev
io-static/input/Sample_Input_data/2009_A_Spring_faked-tm
io-static/input/Sample_Input_data/2009_B_Summer-events
io-static/input/Sample_Input_data/2009_B_Summer-teams
io-static/input/Sample_Input_data/2009_C_Fall-events
io-static/input/Sample_Input_data/2009_C_Fall-teams
io-static/input/Sample_Input_data/2010_A_Spring-events
io-static/input/Sample_Input_data/2010_A_Spring-events.csv
io-static/input/Sample_Input_data/2010_A_Spring-teams
io-static/input/Sample_Input_data/2010_A_Spring-teams.csv
io-static/input/Sample_Input_data/2010_A_Spring-tm-short.csv
io-static/input/Sample_Input_data/2010_A_Spring-tm-test
io-static/input/Sample_Input_data/2010_B_Summer-events
io-static/input/Sample_Input_data/2010_B_Summer-teams
io-static/input/Sample_Input_data/2010_C_Fall-events
io-static/input/Sample_Input_data/2010_C_Fall-teams
io-static/input/Sample_Input_data/2011_A_Spring-events
io-static/input/Sample_Input_data/2011_A_Spring-teams
io-static/input/Sample_Input_data/2011_B_Summer-events
io-static/input/Sample_Input_data/2011_B_Summer-events-smtn
io-static/input/Sample_Input_data/2011_B_Summer-teams
io-static/input/Sample_Input_data/2011_B_Summer-teams-smtn
io-static/input/Sample_Input_data/events-2008_combined
io-static/input/Sample_Input_data/splittest.txt
io-static/input/Sample_Input_data/upload-events.txt
io-static/input/Sample_Input_data/upload-teams.txt
io-static/input/Sample_Input_data/zipcodes.db
io-static/input/tourn-options.txt
io-static/input/TSL_data
io-static/input/TSL_data/old
io-static/input/TSL_data/old/TSL_build-2008-10-04.txt
io-static/input/TSL_data/old/TSL_build-2008-10-11.txt
io-static/input/TSL_data/old/TSL_build-2008-10-18.txt
io-static/input/TSL_data/old/TSL_build-2008-10-25.txt
io-static/input/TSL_data/TSL_build-2007-05-05.txt
io-static/input/TSL_data/TSL_build-2007-05-12.txt
io-static/input/TSL_data/TSL_build-2007-05-19.txt
io-static/input/TSL_data/TSL_build-2007-06-02.txt
io-static/input/TSL_data/TSL_build-2007-10-06.txt
io-static/input/TSL_data/TSL_build-2007-10-13.txt
io-static/input/TSL_data/TSL_build-2007-10-20.txt
io-static/input/TSL_data/TSL_build-2007-10-27.txt
io-static/input/TSL_data/TSL_build-2007-11-10.txt
io-static/input/TSL_data/TSL_build-2008-05-10.txt
io-static/input/TSL_data/TSL_build-2008-05-17.txt
io-static/input/TSL_data/TSL_build-2008-05-31.txt
io-static/input/TSL_data/TSL_build-2008-10-04.txt
io-static/input/TSL_data/TSL_build-2008-10-11.txt
io-static/input/TSL_data/TSL_build-2008-10-18.txt
io-static/input/TSL_data/TSL_build-2008-10-25.txt
io-static/input/TSL_data/TSL_build-2009-04-25.txt
io-static/input/TSL_data/TSL_build-2009-05-02.txt
io-static/input/TSL_data/TSL_build-2009-05-09.txt
io-static/input/TSL_data/TSL_build-2009-05-16.txt
io-static/input/TSL_data/TSL_build-2009-05-23.txt
io-static/input/TSL_data/TSL_build-2009-05-30.txt
io-static/input/TSL_exceptions
io-static/input/TSL_preferred
io-static/input/TSL_preferred-auto
io-static/input/TSL_preset_2007_A_Spring
io-static/input/TSL_preset_2007_C_Fall
io-static/input/TSL_preset_2008_A_Spring
io-static/input/zips.csv.gz
io-static/schedules
io-static/schedules/general.css
io-static/schedules/gs.jpg
io-static/schedules/return.jpg
io-static/schedules/rules-old.pdf
io-static/schedules/rules.pdf
io-static/schedules/template.css
io-static/schedules/ts.jpg
io-static/schedules/usyvl.css
io-static/schedules/usyvl_bg.css
io-static/schedules/usyvl_site_content.css
io-static/schedules/usyvlbanner.jpg
io-static/schedules/vbsmrwb.png