OSGeo Planet

Tyler Mitchell: Query Vector Data Using a WHERE Clause – ogrinfo

OSGeo Planet - 19 hours 4 min ago
addressThe following is an excerpt from the book: a href=http://locatepress.com/gpt target=_blank title=Geospatial Power ToolsGeospatial Power Tools – Open Source GDAL/OGR Command Line Tools/a by Tyler Mitchell.  The book is a comprehensive manual as well as a guide to typical data processing workflows, such as the following short sample…/address h2Use SQL Query Syntax with ogrinfo/h2 pUse a SQL-style -where clause option to return only the features that meet the expression. In this case, only return the populated places features that meet the criteria of having NAME = ’Shanghai’:/p pre$ ogrinfo 10m_cultural ne_10m_populated_places -where NAME = 'Shanghai' ... Feature Count: 1 Extent: (-179.589979, -89.982894) - (179.383304, 82.483323) ... OGRFeature(ne_10m_populated_places):6282 SCALERANK (Integer) = 1 NATSCALE (Integer) = 300 LABELRANK (Integer) = 1 FEATURECLA (String) = Admin-1 capital NAME (String) = Shanghai ... CITYALT (String) = (null) popDiff (Integer) = 1 popPerc (Real) = 1.00000000000 ls_gross (Integer) = 0 POINT (121.434558819820154 31.218398311228327)/pre pBuilding on the above, you can also query across all available layers, using the -al option and removing the specific layer name. Keep the same -where syntax and it will try to use it on each layer. In cases where a layer does not have the specific attribute, it will tell you, but will continue to process the other layers:/p pre ERROR 1: 'NAME' not recognised as an available field. /pre pNOTE: More recent versions of ogrinfo appear to not support this and will likely give FAILURE messages instead./p hr / pa href=http://locatepress.com/gpt target=_blank title=Geospatial Power ToolsGeospatial Power Tools/a is 350 pages long – 100 of those pages cover these kinds of workflow topic examples.  Each copy includes a complete (edited!) set of the GDAL/OGR command line documentation as well as the following topics/examples:/p h3Workflow Table of Contents/h3 ol liReport Raster Information – gdalinfo 23/li liWeb Services – Retrieving Rasters (WMS) 29/li liReport Vector Information – ogrinfo 35/li liWeb Services – Retrieving Vectors (WFS) 45/li liTranslate Rasters – gdal_translate 49/li liTranslate Vectors – ogr2ogr 63/li liTransform Rasters – gdalwarp 71/li liCreate Raster Overviews – gdaladdo 75/li liCreate Tile Map Structure – gdal2tiles 79/li liMapServer Raster Tileindex – gdaltindex 85/li liMapServer Vector Tileindex – ogrtindex 89/li liVirtual Raster Format – gdalbuildvrt 93/li liRaster Mosaics – gdal_merge 97/li /ol
Categories: OSGeo Planet

GeoServer Team: GeoServer 2.5.3 released

OSGeo Planet - Fri, 2014-10-24 13:16
pThe GeoServer team is happy to announce the release of a href=http://geoserver.org/release/2.5.3/ target=_blank title=GeoServer 2.5.3GeoServer 2.5.3/a. Download bundles are provided (a href=http://sourceforge.net/projects/geoserver/files/GeoServer/2.5.3/geoserver-2.5.3-bin.zip/download target=_blankzip/a, a href=http://sourceforge.net/projects/geoserver/files/GeoServer/2.5.3/geoserver-2.5.3-war.zip target=_blankwar/a, a href=http://sourceforge.net/projects/geoserver/files/GeoServer/2.5.3/geoserver-2.5.3.dmg/download target=_blankdmg/a and a href=http://sourceforge.net/projects/geoserver/files/GeoServer/2.5.3/geoserver-2.5.3.exe/download target=_blankexe/a)  along with documentation and extensions./p pGeoServer 2.5.3 is the next the stable release of GeoServer and is recommended for production deployment. Thanks to everyone taking part, submitting fixes and new functionality:/p ul liA new process, PagedUnique, to efficiently grab large amounts of unique values from a layer column/li liLegend preview functionality in the style editor/li liA long awaited fix for poor font rendering when creating transparent map/li liSome fixes in WFS 2.0 joins/li liGeoJSON CRS syntax has been updated to the current valid one (we were using a old legacy one)/li liSome GetFeatureInfo further fixes for complex styles/li liFix scale computation when the CRS unit of measure is not meters/li liSome WMS 1.3 rendering fixes with image mosaics/li liAvoid invalid reports of leaked connections when using SHAPE-ZIP output format against SQL views whose SQL is no more valid/li liCheck the a href=http://jira.codehaus.org/secure/ReleaseNote.jspa?projectId=10311amp;version=20515 target=_blankrelease notes/a for more details/li liThis release is made in conjunction with GeoTools 11.3/li /ul h1About GeoServer 2.5/h1 pArticles and resources for GeoServer 2.5 series:/p ul lia href=http://www.geo-solutions.it/blog/geoserver-supports-footprints-imagemosaic/ target=_blankGeoServer now supports Vector Footprints for ImageMosaic/a/li lia href=http://boundlessgeo.com/2014/04/harvesting-metadata-using-csw/ target=_blankHarvesting Metadata using CSW/a/li lia href=http://www.geo-solutions.it/blog/developers-corner-caveats-geoserver-jndi-configuration/ target=_blankCaveats in GeoServer JNDI configuration/a/li lia href=http://www.geo-solutions.it/blog/developers-corner-supporting-wind-barbs-geoserver-geotools/ target=_blankSupporting Wind Barbs In GeoServer and GeoTools/a/li lia href=http://boundlessgeo.com/2014/04/deterministic-rendering-order-in-sld/ target=_blankDeterministic rendering order in SLDs/a/li lia href=http://boundlessgeo.com/2014/02/secure-connections-heroku/ target=_blankSecure GeoServer connections to Postgres for Heroku/a/li lia href=http://boundlessgeo.com/2014/02/labelling-a-multipoint-geometry-with-wps/ target=_blankLabelling a MultiPoint geometry with WPS/a/li liGeoServer 2.5-beta announcement reviews a href=http://blog.geoserver.org/2014/01/21/geoserver-2-5-beta-released/ target=_blank title=GeoServer 2.5-beta releasedkey features of this release/a: ul liWCS 2.0 and WCS 2.0 Earth Observation have been added (thanks to DLR and Eumesat for funding this)/li liThe addition of a batch importer to making setting up GeoServer easier (thanks to a href=http://mapstory.org/ target=_blank title=MapStoryMapStory/a)./li liHigh performance PNG encoder based on a href=https://code.google.com/p/pngj/ target=_blank title=PNGJ LibraryPNGJ library/a (Andrea Aime). Improved JPEG performance using a href=http://libjpeg-turbo.virtualgl.org/ target=_blanklibjpegturbo/a available as an optional extension (Simone Giannecchini and Daniele Romagnoli)/li liUse of ST_Simplify to improve PostGIS rendering performance (a collaboration with Andrea and Jonathan Moules)./li liNew implementation of GetFeatureInfo that takes into account symbol shapes, offsets, and dynamic line widths into account (thanks to Eskilstuna municipality for funding this)./li /ul /li lia href=http://blog.geoserver.org/2014/01/07/using-geoserver-at-ign-the-french-national-mapping-agency-to-create-new-digital-maps/ target=_blank title=Using GeoServer and IGN to create new digital mapsUsing GeoServer at IGN to create new digital maps/a is an impressive look at advanced styling deployed by the french mapping agency/li lia href=http://boundlessgeo.com/2014/02/labelling-a-multipoint-geometry-with-wps/ title=http://boundlessgeo.com/2014/02/labelling-a-multipoint-geometry-with-wps/Labelling a MultiPoint geometry with WPS/a (Boundless) is a good example of integrating WPS and Styling/li lia href=http://geo-solutions.blogspot.it/2014/02/geoserver-improved-scalability.html target=_blank title=Achieving Extreme GeoServer Scalability with the new Marlin vector rasterizerAchieving extreme GeoServer Scalability with new Marlin vector rasterizer/a (GeoSolutions) shows an exciting JRE extension that can be used for improved performance. If you are using GeoServer with a large number of CPU cores you owe yourself an hour to try this out./li lia href=http://geo-solutions.blogspot.it/2014/01/geoserver-dxf.html target=_blank title=Developer's Corner: DXF output format promoted to official extension for GeoServerDXF output format promoted to official extension for GeoServer/a (GeoSolutions)/li lia href=http://geo-solutions.blogspot.it/2014/01/geoserver-activedirectory.html target=_blank title=Active Directory based security in GeoServer through LDAPActive Directory based security in GeoServer through LDAP/a (GeoSolutions)/li /ul p /p
Categories: OSGeo Planet

GeoTools Team: GeoTools 11.3 released

OSGeo Planet - Fri, 2014-10-24 12:48
divspan style=font-size: 14px;The GeoTools community is happy to announce the latest  /spana href=http://sourceforge.net/projects/geotools/files/GeoTools%2011%20Releases/11.3/ style=color: #ca7900; font-size: 14px; target=_blankGeoTools 11.3 download/aspan style=font-size: 14px;:/span/divdiv class=post-body entry-content id=post-body-2992135552493375359 style=background-color: white;div dir=ltrullia href=http://sourceforge.net/projects/geotools/files/GeoTools%2011%20Releases/11.3/geotools-11.3-bin.zip/download style=color: #ca7900; target=_blankgeotools-11.3-bin.zip/a/lilia href=http://sourceforge.net/projects/geotools/files/GeoTools%2011%20Releases/11.3/geotools-11.3-doc.zip/download style=color: #ca7900; target=_blankgeotools-11.3-doc.zip/a/lilia href=http://sourceforge.net/projects/geotools/files/GeoTools%2011%20Releases/11.3/geotools-11.3-userguide.zip/download rel=nofollow style=color: #ca7900;geotools-11.3-userguide.zip/a/lilia href=http://sourceforge.net/projects/geotools/files/GeoTools%2011%20Releases/11.3/geotools-11.3-project.zip/download style=color: #ca7900; target=_blankgeotools-11.3-project.zip/a/li/uldivThis release is also available from our a href=http://download.osgeo.org/webdav/geotools/ style=color: #ca7900;maven repository/a. This release is made in conjunction with GeoServer 2.5.3./divdivbr //divspanThis is a release of the GeoTools 11 Stable series recommended for production systems. The /spana href=https://github.com/geoserver/geoserver/wiki/Release-Schedulerelease schedule/aspan style=font-family: Lucida Grande, Lucida Sans Unicode, Geneva, Verdana, sans-serif;span now offers 6 months of stable releases followed by six months of maintenance releases./span/spanbr /divbr //divdivA few highlights from the a href=http://jira.codehaus.org/secure/ReleaseNote.jspa?projectId=10270amp;version=20516 style=color: #ca7900; target=_blankGeoTools 11.3-Release Notes/a:/divullispan style=font-family: Lucida Grande, Lucida Sans Unicode, Geneva, Verdana, sans-serif;span style=font-size: 14px; line-height: 21px;Rendering fixes related to cut geometries/labels at map tile borders/span/span/lilispan style=font-family: Lucida Grande, Lucida Sans Unicode, Geneva, Verdana, sans-serif;span style=font-size: 14px; line-height: 21px;Several improvements/fixes to the NetCDF readers/span/span/lilispan style=font-family: Lucida Grande, Lucida Sans Unicode, Geneva, Verdana, sans-serif;span style=font-size: 14px; line-height: 21px;Table hints for SQL Server can be specified at the store level, and it's now possible to force SQL Server to use spatial indexes/span/span/lilispan style=font-family: Lucida Grande, Lucida Sans Unicode, Geneva, Verdana, sans-serif;span style=font-size: 14px; line-height: 21px;A good set of JDBC related fixes, for joins, multi-geometry tables, spurious error reports against invalid sql views/span/span/lilispan style=font-family: Lucida Grande, Lucida Sans Unicode, Geneva, Verdana, sans-serif;span style=font-size: 14px; line-height: 21px;Make sure SortedSimpleFeatureCollection makes full use of the merge-sort sorter and respects the system wide in memory limits (was going straight and fully to disk before)/span/span/li/uldivThanks to Andrea for this release (GeoSolutions)./divh2About GeoTools 11/h2divSummary of the new features for the GeoTools 11 series:/divulliThe DataStore API has a new a href=http://docs.geotools.org/latest/userguide/library/api/datastore.html style=color: #ca7900;removeSchema/a method to drop feature types. This new optional feature is currently implemented by the JDBCDataStore family (all spatial database backed stores), other stores will likely throw an UnsupportedOperationException/liliJDBCDataStore now exposes facilities to a href=http://docs.geotools.org/latest/javadocs/org/geotools/jdbc/JDBCDataStore.html#createIndex(org.geotools.jdbc.Index) style=color: #ca7900;list, create and destroy indexes/a on database columns./liliAbility to create and drop databases from the PostgisNGFactory/liliPostGis data store will now call ST_Simplify when the GEOMETRY_SIMPLIFICATION hint is provided, a href=http://osgeo-org.1560.x6.nabble.com/Some-interesting-optmizations-from-Jonathan-s-load-test-td5095839.html#a5096070 style=color: #ca7900;significantly speeding up loading of complex geometries /a (the renderer can perform scale based simplification already, but doing it before sending the data speeds up data retrieval significantly)/liliImageMosaic can now manage vector footprints for its granules, allowing to filter out no-data or corrupted sections of the imagery/liliAll properties in a SLD style can now have a a href=http://geo-solutions.blogspot.it/2014/01/css-uom.html style=color: #ca7900;local unit of measure/a, as opposed to specifying the unit of measure per symbolizer. For example, if you need to have a line width to be 10 meters, its value can now be 10m/liliImproved handling of data with 3D coordinates in JDBC data stores/liliA number of small improvements to the rendering engine, such as improved raster icon placement resulting in cleaner, less blurry output, improved label grouping, better handling of icons at the border of the map and in general much improved estimation of the buffer area needed to include all symbols in a map (for features that sit outside the map, but whose symbols are big enough to enter it)./li/ul/div/div
Categories: OSGeo Planet

GeoSpatial Camptocamp: FOSS4G 2014 : nos présentations et workshops

OSGeo Planet - Fri, 2014-10-24 08:51
pCette année, près de 900 personnes étaient réunies pour échanger sur les nouvelles technologies Open Source en Geospatial à a href=https://2014.foss4g.org/ target=_blank title=Foss4G 2014FOSS4G/a./p h4Présentations et workshops/h4 pCamptocamp a donné plusieurs présentations et workshops autour de nos projets. Éric Lemoine a présenté « emOpenLayers 3 : a unique mapping library/em » ainsi que co-présenté deux workshops, l’un sur empgRouting/em (avec Daniel Kastl) et l’autre sur emOpenLayers 3/em (avec Tim Schaub et Andreas Hocevar). Jesse Eichar a également exposé son travail sur la version 3 de emMapfish Print/em./p pVous trouverez ci-dessous, les présentations et les vidéos en ligne :/p ul lia href=http://vimeo.com/106235582 target=_blank title=MapFish printOpenLayers 3 : a unique mapping library/a/li lia href=http://vimeo.com/106235582 target=_blank title=MapFish printMapFish Print V3/a/li /ul pAinsi que les workshops :/p ul lia href=http://workshop.pgrouting.org/ target=_blank title=pgRouting WorshopOpenLayers 3 Workshop/a/li lia href=http://workshop.pgrouting.org/ target=_blank title=pgRouting WorshoppgRouting Workshop/a/li /ul pL’ensemble de ces présentations et workshops ont fait salle comble et nous avons pu remarquer beaucoup d’intérêt autour de ces projets./p h4Communautés/h4 pCamptocamp a participé à différentes sessions dont celle sur WebGL. Les interactions et les échanges que nous avons eus nous rendent enthousiastes sur les évolutions de cette technologie et son intégration au sein de projets comme a href=http://openlayers.org/ target=_blank title=OpenLayers 3OpenLayers 3/a, sur lequel Camptocamp prévoit de travailler dans les tous prochains mois. Cette intégration va permettre de meilleures performances et des fonctionnalités améliorées. Le prototype que nous avions développé il y a plusieurs mois a permis d’avancer dans cette direction. Nous vous tiendrons au courant de ces évolutions très prochainement./p pNous avons également pu échanger avec les utilisateurs de GeoNetwork sur la nouvelle version de l’interface de l’outil de catalogage. Celle-ci est une refonte complète de l’ancienne version avec Angular, Bootstrap et OpenLayers 3. Cette nouvelle version est grandement appréciée par les utilisateurs : plus intuitive, plus propre, elle apparaîtra par défaut dans la prochaine version de a href=http://geonetwork-opensource.org/ target=_blank title=GeoNetworkGeoNetwork/a (version 3)./p h4Conclusion/h4 pChaque année, nous sommes très enthousiasmés par la dynamique autour des FOSS4G auxquels Camptocamp est toujours ravi de participer, via ses projets et ses contributions./p pRendez-vous donc à Séoul pour a href=http://foss4g2015.wordpress.com/ target=_blank title=Foss4G 2015FOSS4G 2015/a du 14 au 19 septembre 2015 !/p pCet article a href=http://www.camptocamp.com/actualite/presentations-lors-du-foss4g-2014-portland-usa/ rel=nofollowFOSS4G 2014 : nos présentations et workshops/a est apparu en premier sur a href=http://www.camptocamp.com rel=nofollowCamptocamp/a./p
Categories: OSGeo Planet

gvSIG Team: 1as Jornadas gvSIG Perú

OSGeo Planet - Fri, 2014-10-24 07:54
pa href=https://gvsig.files.wordpress.com/2014/10/00_peru.jpgimg alt=00_Peru class=alignleft size-full wp-image-2562 src=https://gvsig.files.wordpress.com/2014/10/00_peru.jpg?w=640 //a/p pMañana, día 25 de octubre de 2014, tendrán lugar las strong1as Jornadas gvSIG Perú/strong. Jornadas impulsadas por la Comunidad gvSIG Perú y que en el décimo aniversario de gvSIG se suman a las ya realizadas por otros países de Latinoamérica y Caribe./p pEn estos diez años se han realizado Jornadas gvSIG, muchas de ellas con periodicidad anual o bianual, en Argentina, Brasil, Chile, México, Paraguay, Uruguay y Venezuela. Ahí ya otras comunidades trabajando en futuras jornadas en países como Ecuador o Bolivia. A todo esto debemos sumar las Jornadas de Latinoamérica y Caribe, que con carácter itinerante representan a la gran comunidad latinoamericana de gvSIG./p pVolviendo a las 1as Jornadas gvSIG Perú, la Comunidad ha preparado un a href=http://www.gvsig.org/plone/community/events/jornadas-peru/2014/Programainteresante programa/a que incluye un conjunto de strongponencias/strong que muestran la aplicabilidad de gvSIG a distintas temática y strongtalleres de formación/strong que permitirán al asistente comenzar su formación en gvSIG./p pY, como todas las jornadas gvSIG, a href=http://www.gvsig.org/plone/community/events/jornadas-peru/2014/Inscripcion target=_blank title=Inscripciónson gratuitas y de libre acceso/a./p pLo dicho, si vives en Perú…no tienes excusa: strongMañana hay jornadas gvSIG/strong/pbr /Filed under: a href=http://blog.gvsig.org/category/gvsig-development/community/community/a, a href=http://blog.gvsig.org/category/gvsig-development/events-gvsig-development/events/a, a href=http://blog.gvsig.org/category/languages/spanish/spanish/a Tagged: a href=http://blog.gvsig.org/tag/peru/Perú/a img alt= border=0 height=1 src=http://pixel.wp.com/b.gif?host=blog.gvsig.orgamp;blog=8230583amp;post=2561amp;subd=gvsigamp;ref=amp;feed=1 width=1 /
Categories: OSGeo Planet

Boundless Blog: Partner Profile: Geospatial Enabling Technologies (GET)

OSGeo Planet - Thu, 2014-10-23 15:11
p dir=ltrema href=http://boundlessgeo.com/about/partners/Boundless partners/a are an important part of spreading the depth and breadth of our software around the world. In this ongoing series, we will be featuring some of our partners and the ways they are expanding the reach of our Spatial IT solutions./em/p p dir=ltra href=http://getmap.gr//aa href=http://getmap.gr/img alt=GET class=alignright size-full wp-image-9248 height=75 src=http://boundlessgeo.com/wp-content/uploads/2013/09/get_grey.png width=150 //aGeospatial Enabling Technologies (GET) was established in 2006 with the vision of becoming one of the leaders for Spatial IT solutions and services in Greece as well as more broadly in Europe and Africa. Specializing in the field of geoinformatics, GET provides robust solutions for both the public and private sector./p p dir=ltrSince 2010, GET has deployed and supported a href=http://boundlessgeo.com/solutions/opengeo-suite/OpenGeo Suite/a as part of their projects. From the very beginning, GET held a strong belief that Boundless was the premier provider for commercial open source spatial software. Through its partnership with Boundless and the use of OpenGeo Suite, GET has been able to implement projects for private companies as well as public authorities and government agencies in Greece including the a href=http://boundlessgeo.com/case-study/get/Hellenic Regulatory Authority of Energy/a and the Greek Ministry of Agriculture. GET has also offered technical support, via the GET SDI Portal, to many public agencies like the Environmental Protection Agency of Athens and the Military Geographic Institute of Ecuador./p p dir=ltr style=text-align: center;a href=http://boundlessgeo.com/case-study/get/img alt=Hellenic Regulatory Authority for Energy (RAE) class=aligncenter wp-image-9230 height=352 src=http://boundlessgeo.com/wp-content/uploads/2013/09/get1.jpg width=564 //a/p p dir=ltr“With the goal to provide advanced geospatial solutions based on open source, we consider Boundless an essential, valuable partner with whom we could design and implement projects effectively,” said Gabriel Mavrellis of GET./p p dir=ltrThis successful partnership derives from a relationship where each organization greatly benefits by sharing knowledge, expertise, opportunities, and vision. The developers and project managers at GET deploy projects based on OpenGeo Suite and share their knowledge and expertise with Boundless through the implementation and maintenance of solutions in Greece and abroad./p p dir=ltrGET has successfully organized training seminars on OpenGeo Suite to provide Greek engineers and developers with a greater familiarity of the platform and its functions. GET is also a proud contributor to a href=http://boundlessgeo.com/solutions/solutions-software/qgis/QGIS/a, providing training and translating a large part of the QGIS user interface into Greek./p pemIf you’d like your company to be considered for our international network of partners, pleasea href=http://boundlessgeo.com/about/contact-us/partners/ contact us/a!/em/p pThe post a href=http://boundlessgeo.com/2014/10/partner-get/Partner Profile: Geospatial Enabling Technologies (GET)/a appeared first on a href=http://boundlessgeo.comBoundless/a./p
Categories: OSGeo Planet

Gis-Lab: Вышел Revolution R Open

OSGeo Planet - Thu, 2014-10-23 11:28
p15 октября a href=http://blog.revolutionanalytics.com/2014/10/introducing-revolution-r-open-and-revolution-r-plus.htmlвышел Revolution R Open/a — версия a href=http://cran.r-project.org/языка R/a от a href=http://projects.revolutionanalytics.com/Revolution Analytics/a, многие годы выпускающих коммерческую версию R, имеющую «встроенную» многопоточночть. Revolution R Open emобладает улучшенной производительностью/em по сравнению со стандартной версией R за счёт использования Intel Math Kernel Libraries (MKL) вместо стандартного R BLAS/LAPACK (при этом не требуется каких-либо дополнительных модификаций вашего кода); полностью совместим с приложениями, пакетами и скриптами, работающими с R 3.1.1; распространяется под лицензией GPLv2./p pRevolution R Open a href=http://mran.revolutionanalytics.com/download/доступен для скачивания/a для следующих платформ:/p liUbuntu 12.04, 14.04/li liCentOS / Red Hat Enterprise Linux 5.8, 6.5, 7.0/li liOS X Mavericks (10.9)/li liWindows® 7.0 (SP 1), 8.0, 8.1, Windows Server® 2008 R2 (SP1) and 2012/li pbr / Так же имеется экспериментальная поддержка для:/p liOpenSUSE 13.1 (обновлённая сборка Revolution R Open для OpenSUSE от 18 октября у меня работает хорошо)/li li OS X Yosemite (10.10)/li pbr / a href=http://www.revolutionanalytics.com/revolution-revor-enterprise-benchmark-detailsЗдесь/a можно посмотреть сравнительные тесты (с воспроизводимым кодом) стандартного R и R от Revolution Analytics./p pВ частности, у меня такие результаты теста умножения матриц для Revolution R Open:/p pregt; set.seed (1) gt; m lt;- 10000 gt; n lt;- 5000 gt; A lt;- matrix (runif (m*n),m,n) gt; system.time (B lt;- crossprod(A)) user system elapsed 14.690 0.141 3.856/pre pВесьма неплохо! Однако не следует ожидать существенного прироста производительности сторонних пакетов. Я, например, тестировал spatstat: как использовалось только одно ядро, так и используется. Может с другими пакетами повезёт больше )))/p
Categories: OSGeo Planet

gvSIG Team: Disponibles vídeos webinars del aniversario de gvSIG: fauna y espacios naturales, criminología, modelador de geoprocesos y curso de gestão de bacias

OSGeo Planet - Thu, 2014-10-23 10:02
pa href=https://gvsig.files.wordpress.com/2014/10/webinar2.jpgimg alt=webinar2 class=alignleft size-full wp-image-2558 src=https://gvsig.files.wordpress.com/2014/10/webinar2.jpg?w=640 //aDurante este mes de octubre ha habido strongcuatro seminarios on-line/strong organizados por strongMundoGEO/strong y realizados por strongdiferentes colaboradores de la Asociación gvSIG/strong. Tres de ellos en español y uno en portugués./p pYa están strongdisponibles las grabaciones/strong de estos webinars. Para todos aquellos que no pudieron ver los seminarios en directo, aquí tenéis los vídeos:/p ul listrongModelizador de geoprocesos en gvSIG/strong: a href=http://vimeo.com/108489406http://vimeo.com/108489406/a/li listronggvSIG aplicado a fauna y espacios naturales protegidos/strong: a href=http://vimeo.com/108483674http://vimeo.com/108483674/a/li listronggvSIG: Herramientas para la gestión del delito/strong: a href=http://vimeo.com/107936502http://vimeo.com/107936502/a/li listronggvSIG Aplicado à Gestão de Bacias/strong: a href=http://vimeo.com/107937197http://vimeo.com/107937197 /a/li /ul pEsperamos que este tipo de iniciativas sean de interés para que la comunidad siga formándose en gvSIG. Y, por supuesto, esperamos seguir ofreciéndoos más seminarios en los próximos meses./pbr /Filed under: a href=http://blog.gvsig.org/category/gvsig-development/events-gvsig-development/events/a, a href=http://blog.gvsig.org/category/products/gvsig-desktop/gvSIG Desktop/a, a href=http://blog.gvsig.org/category/languages/portuguese/portuguese/a, a href=http://blog.gvsig.org/category/languages/spanish/spanish/a, a href=http://blog.gvsig.org/category/gvsig-development/training/training/a Tagged: a href=http://blog.gvsig.org/tag/bacias/bacias/a, a href=http://blog.gvsig.org/tag/crime/crime/a, a href=http://blog.gvsig.org/tag/fauna/fauna/a, a href=http://blog.gvsig.org/tag/geoprocesos/geoprocesos/a, a href=http://blog.gvsig.org/tag/modelador/modelador/a, a href=http://blog.gvsig.org/tag/webinar/webinar/a img alt= border=0 height=1 src=http://pixel.wp.com/b.gif?host=blog.gvsig.orgamp;blog=8230583amp;post=2557amp;subd=gvsigamp;ref=amp;feed=1 width=1 /
Categories: OSGeo Planet

gvSIG Team: The second Release Candidate of the gvSIG 2.1 version is now available

OSGeo Planet - Thu, 2014-10-23 07:47
pThe second gvSIG 2.1 Release Candidate (gvSIG 2.1 RC2) has been released [1]./p pDuring the stabilization process from the first release candidate a lot of errors have been fixed, and some new functionalities have been included in gvSIG 2.1 too, like a new layout with TOC (table of contents), new grid functionalities, memory management at the Preferences menu or the possibility to add layers to the view dragging the file from the file browser directly./p pWe encourage you to test this version and send us any errors and suggestions in the users mailing list in English [2] or Spanish [3] or directly in the bugtracker (see interesting links for testers [4])./p pThe complete list of the main new features of gvSIG 2.1 can be consulted on [5]./p pThanks for your collaboration./p p[1] a href=http://www.gvsig.org/web/projects/gvsig-desktop/official/gvsig-2.1/downloadshttp://www.gvsig.org/web/projects/gvsig-desktop/official/gvsig-2.1/downloads/abr / [2] a href=http://listserv.gva.es/cgi-bin/mailman/listinfo/gvsig_internacionalhttp://listserv.gva.es/cgi-bin/mailman/listinfo/gvsig_internacional/abr / [3] a href=http://listserv.gva.es/cgi-bin/mailman/listinfo/gvsig_usuarios target=_blankhttp://listserv.gva.es/cgi-bin/mailman/listinfo/gvsig_usuarios /abr / [4] a href=http://www.gvsig.org/web/docusr/doctesting/interesting-links-for-testers/view?set_language=enhttp://www.gvsig.org/web/docusr/doctesting/interesting-links-for-testers/view?set_language=en/abr / [5] a href=http://www.gvsig.org/web/projects/gvsig-desktop/official/gvsig-2.1/notas-de-version/new-featureshttp://www.gvsig.org/web/projects/gvsig-desktop/official/gvsig-2.1/notas-de-version/new-features/a/pbr /Filed under: a href=http://blog.gvsig.org/category/gvsig-development/development/development/a, a href=http://blog.gvsig.org/category/languages/english/english/a, a href=http://blog.gvsig.org/category/products/gvsig-desktop/gvSIG Desktop/a, a href=http://blog.gvsig.org/category/gvsig-development/testing/testing/a img alt= border=0 height=1 src=http://pixel.wp.com/b.gif?host=blog.gvsig.orgamp;blog=8230583amp;post=2554amp;subd=gvsigamp;ref=amp;feed=1 width=1 /
Categories: OSGeo Planet

Even Rouault: Blending metadata into vector formats

OSGeo Planet - Wed, 2014-10-22 21:50
div style=text-align: justify;This post explores a few ideas, and the resulting experiments, I've had recently to put metadata (or arbitrary information) into vector GIS formats that have no provision for them. One typical such format is the good-old a href=http://dl.maptools.org/dl/shapelib/shapefile.pdfShapefile format/a. A shapefile generally consists in 3 files, a .shp file that contains the geometries, a .shx that is an index from the shape number to the offset in the .shp file where the geometry is located (to allow fast retrieval by shape ID) and a .dbf file that contains the attributes of each shape./divdiv style=text-align: justify;Of course, the most simple way of adding metadata would be to but an additional file besides the 3 mentionned ones, but that would not be very challenging (plus the risk of losing it during copy)./divdiv style=text-align: justify;Most implementations require at least those 3 files to be present. Some allow .dbf to be missing (e.g. a href=http://gdal.org/GDAL/OGR/a). Some allow .shx to be missing, like a href=http://www.openjump.org/OpenJUMP/a which doesn't read it even if it is available, which is both a feature and a drawback in a href=http://trac.osgeo.org/gdal/ticket/5706situations when there are holes/a in the .shp due to editing./divbr /div style=text-align: justify;A basic solution is to add our metadata at the end of one of those 3 files. I've done tests with GDAL/OGR (based on a href=http://shapelib.maptools.org/Shapelib/a), a href=http://www.geotools.org/GeoTools/a 12.0, OpenJUMP 1.7.1 (whose shapefile reader is a forked version of the GeoTools one with changes), proprietary software code-named GM and proprietary software AG /divdiv style=text-align: justify;.dbf : all 5 implementations are happy with extra content at the end of the file/divdiv style=text-align: justify;.shp : all implementations happy, except OpenJUMP that opens the file, but throws a warning because it tries to interprete the additional bytes as shape./div.shx : all 5 implementations are happybr /div style=text-align: justify;So we have at least 2 possibilities that are rather portable./divdiv style=text-align: justify;It should be checked how they react in editing use cases, like adding new features to the shapefile. Regarding GDAL/OGR, I can say that it would overwrite the extra content at the end of the .dbf and the .shx. It would let the extra content at the end of the .shp to write the new geometry afterwards./divbr /div style=text-align: justify;What if we want to link the metadata per feature in a way where it is preserved if shapes are added ? And for the sake of exploring more possibilities, we will exclude using the data-at-end-of-file track. Interleaving data and metadata is not possible in .dbf since the records are placed consecutively. Same for .shx. In .shp, we can try reserving some space between all geometry records and make sure that the .shx index takes the holes into account. Due to the fact that size and offsets in shapefile are expressed in term of 16 bit words, that extra space must be a multiple of 16 bit too. That works fine for all implementations, except OpenJUMP for the same reason as above. Hum, and what if we incorporate the metadata, not between the encoded geometries, but inside them ? Each geometry record is indeed structured like this :/divbr /Shape Id: 4 bytesbr /Record length (number of 16 bit words after that field): 4 bytesbr /Record content: (2 * record length) bytesbr /    Shape Type: 4 bytesbr /    Variable payload according to shape typebr /br /div style=text-align: justify;We can try adding extra payload at the end of record content while still updating record length to take into account. We could have thought that implementations strictly checks that the declared record length is consistant with the shape type, but experimentations (and code inspection on the 3 Open Source implementations) show that, when they check, they check that the record length is at least greater or equal to the minimum expected record length. So this works for the 5 implementations ! At least on a layer with 2D polygons. That should also work for other 2D geometry type. 3D shapes consist in the 2D information, followed by the Z information, and optionaly by the M(eausre) information. M information is sometimes omitted when it is not present (this is the case of the OGR writer). So if we would want to add metadata for 3D shapes, we would have to write dummy M information (writting not-a-number double values is commonly done to indicate that M information is invalid)./divbr /div style=text-align: justify;To go back to .dbf file a bit, sometimes the width of fields of string type is larger than strictly needed. The values are left aligned in the field and remaining space is padded with space characters. I've tried to insert a nul character just at the end of the string, and put the extra information afterwards. This works fine for the 3 C/C++ based shapefile readers (GDAL/OGR, G.M., A.G) since nul character is conventionnaly used to terminate a string in C/C++. Unfortunately that does not work with the 2 Java based implementations that do not use that convention : the extra content is displayed after the field content./divbr /div style=text-align: justify;As we have started exploring modifying the data itself, let's return to .shp file. One thing to consider is that coordinates in shapefiles are stored as double precision floating point numbers, stored on 64 bits using the a href=http://en.wikipedia.org/wiki/Double-precision_floating-point_formatIEEE-754 binary representation/a. Such numbers are decomposed like the following : 1 bit for the sign of the value, 11 bits for the exponent and its sign and 52 bits for the mantissa. The mantissa is where the significand precision of the number is stored. How big is that ? Let's go back to geography a bit. The Earth has rougly a circonference of 40 000 km. If we want to map features with a precision of 1 cm, we need 40 000 000 / 0.01 = 4 billion distinct numbers. 4 billion fits conveniently on a 32 bit integer (and a href=http://wiki.openstreetmap.org/wiki/PBF_FormatOpenStreetMap .pbf /aoptimized format store coordinates on 32 bit integers based on that observation). So 52 bits allow 2^(52-32)=2^20, roughly 1 million more numbers, i.e. a precision of 10^-8 meters = 10 nanometers ! We could almost map every molecule located on the Earth surface !/divdiv style=text-align: justify;It is consequently reasonable to borrow the 16 least significant bits from the mantissa for other use. Said differently for every 2D point/vertex, we can get back 4 bytes without any noticeable loss of precision. Depending on the shape complexity, this might be not big enough to store per-feature metadata. But on a typical shapefile, if we spead the metadata over the features, we can certainly store useful content. And the really great news is that this metadata would be preserved naturally in most format conversions (at least with GDAL/OGR whose internal geometry representation also uses 64-bit floating point numbers, and probably most other geometry engines), and for formats like a href=https://www.gaia-gis.it/fossil/libspatialite/indexSpatialite/a or a href=http://www.geopackage.org/GeoPackage/a that also use 64-bit floating point numbers. However, one must be aware than any other operation like rescaling or reprojection would completely change the least significant bits and erase our metadata./divbr /div style=text-align: justify;Admitedly this is not a new idea. People have explored similar ideas for a href=http://en.wikipedia.org/wiki/Digital_watermarkingdigital watermarking/a and more generally a href=http://en.wikipedia.org/wiki/Steganographysteganography/a, typically used to embed copyright information or source tracking (i.e. you generate a slightly different dataset for each customer, hence if a copy is then available for download, you can identify the origin of the leak), generally in a not noticeable way. Using least significant bits is the very basic technique, that can be circumvented easily by just zeroing them or adding noise. More advanced technique operate in the a href=http://en.wikipedia.org/wiki/Frequency_domainspectral domain/a, like a href=http://en.wikipedia.org/wiki/Discrete_cosine_transformDCT/a (Discrete Cosine Transform), a href=http://en.wikipedia.org/wiki/Discrete_Fourier_transformDFT/a (Discrete Fourier Transform) or a href=http://en.wikipedia.org/wiki/Discrete_wavelet_transformDWT/a (Discrete Wavelet Tranform). Some techniques have been specifically designed for GIS data, using topological properties for example. The common target of those techniques is to have robustness against attempts of removing the watermark from the signal, at the expense of a reduced bandwith for the inserted information. But for regular metadata, we do not need such guarantee and the use of least-significant bits might be good enough and easily implemented./divbr /Any other ideas ? Sure...br /br /div style=text-align: justify;For polygons, the shapefile specification states that the vertices of the outer ring must be listed in clockwise order. But it does not specify which vertex of the outline must be the first one. Let's consider that the top-most vertex of the polygon is numbered 0 (if there are several vertices with the same y coordinate, let's take the one of them with the minimum x), the following vertex in clockwise order is 1, etc... If our polygon has 16 vertices, and we serialize it starting at vertex 11, we have coded the 11 number. Combined with information of following polygons, we can build a longer message. This idea could only work in practice for shapefiles of complex/dense enough polygons. If every polygon has 256 vertex, we can encode log2(256)=8 bits per polygon. More generally, for a polygon with N vertex, we could encode log2(N) bits (rounded to inferior integer). So we need also at least hundreds or thousands of polygons of that complexity to be able to encode something useful. The advantage of this technique is that it is robust to rescaling, and probably most reprojections (at least the one that globally preserve the appearance of shapes), provided that the shapes are rewritten in the same order as in the original data./divdiv style=text-align: justify;That technique could also be adapted for lines. Let's consider a line made of (V1,V2,....Vn). We can for example simply build a multi-polyline of 2 parts (V1,...Vi) and (Vi,....,VN) that will visually looks like the original line and will encode for the i value. The increase in binary encoding would be modest (4+8+8=20 extra bytes)./divbr /div style=text-align: justify;Another technique might be to use repeated vertices. Let's consider a line or a polygon: if while listing consecutive vertices, they are repeated, this would encode a 1 value. Otherwise 0. For example, if a line is made of the sequence of vertices (V1,V1,V2,V3,V4,V4,V5,V5,V6), it would be equivalent to binary number 100110. So we could encode as many bits as vertices in the geometry. If needed, we can also use more repetitions to encode more bits. For one bit per vertex, on average such a technique would increase shapefile size by 50% (because on average, half of bits in a message are 1). It would preserve metadata perfectly for all coordinate transformations (geometry engines generally operate on vertices separately). But not to operations that would remove duplicated vertices./divbr /div style=text-align: justify;Finally, here's another idea, conceptually close to the one based on the starting vertex. Excluding implementations that don't rely on the .shx (I've no prejudice against such one ! Keep on good work folks !), we could use the order of shapes in the .shp to encode information. Traditionnaly, feature 1 appears first in the .shp, followed by feature 2, etc... But we could re-order the shapes as we wish, provided we make the .shx point to the right offset in the .shp. If we have N shapes, there are N! (a href=http://en.wikipedia.org/wiki/Factorialfactorial/a(N) = N*(N-1)*(N-2)*...2*1) ways of ordering them. So for N shapes, we can encode log2(N!) bits. In practice for 10 shapes, that is 21 bits. For 100 shapes, 524 bits. For 1000 shapes, 8529 bits. And for 10000, 118458. Advantages: works for all geometry types, no increase in file size. Inconvenients: possibly less performant sequential reading because of apparently random seeking within the .shp, doesn't resist to file conversion./divbr /div style=text-align: justify;I've not mentionned it, but for nearly all mentionned techniques, especially the last ones, we would need to reserve a few bits to insert a CRC or any other integrity mechanism, so as to make sure that we think is metadata really is. And all them could be potentially combined !/div
Categories: OSGeo Planet

gvSIG Team: Open Planet Especial nº1: 10 años gvSIG “gvSIG: no sólo ciencia. Recopilatorio de escritos”

OSGeo Planet - Wed, 2014-10-22 11:46
pEstamos de aniversario. Una década en la que el proyecto gvSIG ha ido construyendo su camino.  Esta efemérides está siendo celebrada de muchas maneras por la Comunidad. A todos esos eventos y actividades queremos unir stronguna recopilación de escritos que durante estos 10 años han aparecido aquí y allá/strong. Escritos que son un reflejo de cómo hemos ido avanzando en el pensamiento de gvSIG, en la interpretación de la realidad desde un proyecto de geomática libre./p pTextos que en ocasiones, como decía Bertolt Brecht, en estos tiempos han de defender lo evidente: que el conocimiento debe ser patrimonio de la humanidad y no de corporaciones, que la colaboración y la solidaridad son valores fundamentales sobre los que construir los modelos de negocio./p pEn gran parte somos recuerdos y recordar lo que hemos defendido y argumentado en cada momento nos permite también definir lo que somos a hoy día. Esta recopilación nos permite afirmar que detrás nuestro no solo queda un camino recorrido. strongLas bases de lo que seremos también están ahí./strong/p pOs dejo con la introducción del recopilatorio que espero que os anime a todos a a href=http://downloads.gvsig.org/download/documents/books/Recopilatorio_10.pdf title=Descarga recopilatoriodescargarlo/a e ir buceando en su lectura:/p pemgvSIG es algo más que ciencia. Economía Ciencia y Política son disciplinas que consideramos relacionadas entre sí y no logramos entenderlas plenamente si no atendemos a la existencia de estas relaciones. Esta idea es recurrente en gvSIG; siempre que podemos la proclamamos./embr / emQuizás, de todas las componentes de gvSIG la que menos se conozca sea la que explique como se ha construido la organización gvSIG, su pensamiento. Este recopilatorio pretende ayudar a explicar este proceso./embr / emEl presente documento es un recopilatorio de algunos escritos que han ido ayudando a crear gvSIG. Escritos de blogs, jornadas o escritos internos. Muchos de ellos van acompañados de un párrafo que ayude a explicar el porqué y los objetivos de cada uno de los escritos. No se trata de un trabajo exhaustivo, pero sí que pensamos que le puede resultar interesante a quien desee conocer los aspectos no técnicos de gvSIG./embr / emSe presentan ordenados por años, añadiendo al final un anexo con otros documentos./embr / emEsperando que os resulte de interés y que puedan servir como una herramienta para la transformación de un futuro que está por escribir./em/p pemAtreveros a soñar y carpe diem/em/p pstrongDescarga:/strong a href=http://downloads.gvsig.org/download/documents/books/Recopilatorio_10.pdfhttp://downloads.gvsig.org/download/documents/books/Recopilatorio_10.pdf/a/pbr /Filed under: a href=http://blog.gvsig.org/category/gvsig-association/gvSIG Association/a, a href=http://blog.gvsig.org/category/opinion/opinion/a, a href=http://blog.gvsig.org/category/languages/spanish/spanish/a img alt= border=0 height=1 src=http://pixel.wp.com/b.gif?host=blog.gvsig.orgamp;blog=8230583amp;post=2549amp;subd=gvsigamp;ref=amp;feed=1 width=1 /
Categories: OSGeo Planet

GeoSpatial Camptocamp: Journée ASIT VD : rencontrez les acteurs de la géoinformation !

OSGeo Planet - Wed, 2014-10-22 09:26
pLe 28 octobre, Camptocamp vous donne rendez-vous à la journée de l’a href=http://20ans.asitvd.ch/ target=_blank title=20ans ASIT-VDASIT VD/a, l’Association pour le Système d’Information du Territoire Vaudois, qui aura lieu au a href=http://20ans.asitvd.ch/#infosPratiques target=_blank title=Swiss Tech directionsSwiss Tech Convention Center/a à Lausanne./p pDepuis 20 ans, l’a href=http://www.asitvd.ch target=_blank title=ASIT VDASIT VD/a facilite l’accès aux géodonnées sur le territoire vaudois et regroupe près de 300 membres autour d’un partenariat public-privé original. A cette occasion, sociétés de services, administrations publiques, écoles et associations, vous présentent leurs produits, activités et nouveautés. Le programme est disponible a href=http://20ans.asitvd.ch/#programmeici/a./p pL’équipe a href=http://www.camptocamp.com/geospatial/ target=_blank title=Geospatial Solutions CamptocampGeospatial Solutions/a de Camptocamp vous accueillera sur son stand et vous présentera démos, formations, et nouveautés. Que vous soyez architecte, municipal, ingénieur ou technicien, venez discuter avec nous de vos projets SIG !/p pCet article a href=http://www.camptocamp.com/actualite/journee-asit-vd-rencontrez-les-acteurs-geoinformation/ rel=nofollowJournée ASIT VD : rencontrez les acteurs de la géoinformation !/a est apparu en premier sur a href=http://www.camptocamp.com rel=nofollowCamptocamp/a./p
Categories: OSGeo Planet

Boundless Blog: QGIS Compared: Visualization

OSGeo Planet - Tue, 2014-10-21 15:22
p dir=ltrimg alt=Gretchen Peterson class=alignright size-full wp-image-9187 height=138 src=http://boundlessgeo.com/wp-content/uploads/2014/03/Gretchen1.png style=margin-left: 10px; width=138 /Any GIS professional who’s been paying attention to the professional chatter in recent years will be wondering about QGIS and whether or not it might meet some or all of their needs. QGIS is open source, similar to proprietary GIS software, runs on a variety of operating systems, and has been steadily improving since its debut in 2002. With a href=http://boundlessgeo.com/solutions/solutions-software/qgis/easy-to-install packages/a, a href=http://boundlessgeo.com/2013/11/opengeo-suite-and-qgis/OpenGeo/aa href=http://boundlessgeo.com/2014/05/citibike-analysis-automated-workflows-qgis/ Suite/aa href=http://boundlessgeo.com/2014/07/ice-cubed-1-data-preparation/ integration/a, and reliable a href=http://boundlessgeo.com/2014/09/announcing-qgis-support/support offerings/a, we obviously see QGIS as a viable alternative to proprietary desktop GIS software such as Esri’s a href=http://www.esri.com/software/arcgis/arcgis-for-desktopArcGIS for Desktop/a./p p dir=ltrBut will it work for you? The short answer is: most likely yes for visualization of most formats of spatial data, probably for analysis of raster and vector data, probably for geographic data editing, and probably for cartographic publishing.  Those are all very subjective assertions based on my personal experience using QGIS for the past seven months but I have been using proprietary GIS for over fourteen years as an analyst and cartographer and have written a href=http://gretchenpeterson.com/cartographers-toolkit.phpa couple/a a href=http://gretchenpeterson.com/gis-cartography.phpof books/a on the subject./p p dir=ltrBy all means give QGIS a try: a href=http://boundlessgeo.com/solutions/solutions-software/qgis/qgis-download/download and install/a it, drag-and-drop a href=http://www.naturalearthdata.com/some data/a into it, and give it a spin. This is definitely a good time to evaluate it and consider adopting it across your organization./p h2 dir=ltrVisualizing spatial data in QGIS/h2 p dir=ltrIn this first post, I’m going to focus on visualizing spatial data in QGIS. These basic functions are straightforward and easy to do in QGIS:/p ol li dir=ltr p dir=ltradding datasets/p /li li dir=ltr p dir=ltrmoving datasets up and down in the layer hierarchy/p /li li dir=ltr p dir=ltrzooming around the map/p /li li dir=ltr p dir=ltrselecting features based on simple point-and-click/p /li li dir=ltr p dir=ltrselecting features based on complex selection criteria/p /li li dir=ltr p dir=ltrviewing attributes/p /li li dir=ltr p dir=ltrcreating graduated color schemes/p /li /ol p dir=ltrimg alt=PostPic1.png height=325px; src=https://lh3.googleusercontent.com/w3an7veRMZ4RRKREcwCVIL__cQsdZWZJbLUjnNp0qtx9_IxhQjwSnutwSUbpbzFOk7JAJtbnwelSKtTcD9Mob0z56CkZ3Gyt8FW3Uap26g8992gzKzF6sWR_NLW7A5rpeQ width=624px; //p h3 dir=ltrStrength: Versatile and efficient format support/h3 p dir=ltrIn fact, QGIS is an effective means of viewing and exploring spatial data of almost any type. If you have complex data, you might be interested to hear that the newest release of QGIS boasts very fast, multi-threaded, rendering of spatial data that may even make it faster than leading competitors. When I began creating the map shown above, I accidentally added all of the a href=http://www.naturalearthdata.com/downloads/10m-cultural-vectors/Natural Earth 1:10m Cultural Vectors/a in triplicate to the project, causing some minor heart-palpitations as I realized it was going to try to render close to 100 vector layers all at once. However, my fears were unfounded as it took only a few seconds for them to render once they were all added. In the realm of visualization, it does most of the other tasks that a GIS professional would expect as well, including support for custom symbol sets (in SVG format). Adding GeoJSON data is simple, just drag a geojson file onto the emLayers/em list. Here, we show a portion of James Fee’s a href=https://github.com/cageyjames/GeoJSON-BallparksGeoJSON repository of baseball stadiums/a:/p p dir=ltrimg alt=BaseballGeoJson.jpg height=189px; src=https://lh5.googleusercontent.com/qZZfU8j70DCZUjFfz3B5GmAPbRbKKwetT1kxx5gFDaCV27MrpSc9jt5oguiwpOtyY9ksBHhE38Fa13ubL0ojMsP1q1pQelQWSgxCwk3WBp673-oZY9FURPC96KGyBWIKkw width=624px; //p h3 dir=ltrMixed results: Raster visualization/h3 p dir=ltrThat said, raster visualization can yield unexpected results depending on what is desired. Some raster datasets have tables that associate bands with RGB values such that specific cell-types are rendered certain colors. Often, landcover datasets will have this kind of structure so that, for example, the raster is rendered with blue for water, green for grass, white for ice, and so on. Unfortunately, QGIS doesn’t yet support rendering based on associated table files for rasters. Another slight irritation is the continuing use of binary ARC/INFO GRID formats by some agencies who distribute raster data to the public. If you have one of these datasets, QGIS can open it but you must point to the w001001.adf file using the raster data import button./p h3 dir=ltrMixed results: On-the-fly reprojection/h3 p dir=ltrOne of the most important ways to make GIS user-friendly is to support on-the-fly projection. I still remember when projecting on-the-fly became a part of the software that I used to use. It was the end of 1999, and life was so much easier when multiple datasets from multiple agencies in multiple projections could all be jammed together into a single project, producing a map where all the data layers were in the correct projected space. This was because reprojecting not only added extra steps requiring you to reproject everything into a common coordinate system even if all you wanted to do was visualize the data, it also meant maintaining multiple copies of the same dataset, which contributed to folder clutter and using up of valuable disk space. QGIS supports reprojection on-the-fly but it is an option that must be set in the project properties dialog. Some glitches with projections still seem to occur from time to time. Zooming in, for example, sometimes causes the map to zoom to a different place than expected. However, this unexpected behavior is inconsistent, not a showstopper, and may be fixed soon./p p dir=ltrimg alt=Projection.png height=488px; src=https://lh3.googleusercontent.com/KA3bsnKz40Yz4sEmV9dHNSiUvwr80-iVRIi1QI_N6Ptq9gAU1pnIJ9XE0NxFHYdZPFZTifkVdL4sKBffMCV-k4enG7ptkdO15ZM32FB_rCgYEjEQIalBRGAg9mvxL6dDWg width=624px; //p h3 dir=ltrHidden gem: Context/h3 p dir=ltrThe other important aspect of visualizing data is having enough underlying context for the data. Country boundaries, city labels, roads, oceans, and other standard map data are crucial. Proprietary GIS software generally contains basemap layers that can easily be turned on and off to support visualization in this manner. QGIS also has this capability, in the form of the OpenLayers plugin, which serves up Google, OpenStreetMap, Bing, and Yahoo basemaps at the click of a button. The OpenLayers plugin is free and installs just like any other QGIS plugin—you search for it in the emPlugins/em menu, press “install,” and make your basemap choice in the Web menu./p p dir=ltrimg alt=OpenLayersPlugin.png height=161px; src=https://lh6.googleusercontent.com/itALtmP3Xcc6yLJbHdqAa5sQT9U5yKLO8-ggXmuoFgbKYoqg5KEvYRxYynAcNQuwUmZULkRnPj8YkY62UP3fsU8mIWe439ppE2LM0aaVe7vXW3N6UolL3t2lHB3zhGWOtw width=624px; //p h2 dir=ltrConclusion/h2 pWhile QGIS may need a small amount of improvement when it comes to raster visualization and on-the-fly projection, these aren’t hindrances to a typical visualization workflow and are only mentioned here out of respect for a fair and balanced assessment. By and large, my testing has convinced me that the robust visualization capabilities that QGIS offers provide more than enough impetus for many organizations to make the switch to QGIS. In later posts, I’ll discuss how QGIS performs with respect to analysis, editing, and cartography./p pThe post a href=http://boundlessgeo.com/2014/10/qgis-compared-p1-visualization/QGIS Compared: Visualization/a appeared first on a href=http://boundlessgeo.comBoundless/a./p
Categories: OSGeo Planet

Peter Batty: Reaction to Apple Maps announcement

OSGeo Planet - Mon, 2014-10-20 17:16
What they announced As predicted by the entire world, Apple announced their new maps application today as part of iOS 6. You can see the keynote presentation of the video here, and Apple's summary information about the Maps app here. Overall my predictions from last week were pretty spot on :) ... they announced that it would have turn by turn directions with voice guidance, real time img height=1 src=http://feeds.feedburner.com/~r/Geothought/~4/bGJqSE8RqPA width=1 /
Categories: OSGeo Planet

GeoTools Team: GeoTools 12.0 Released

OSGeo Planet - Mon, 2014-10-20 13:46
div dir=ltr style=text-align: left;div style=text-align: left;The GeoTools team is happy to announce the release of version 12.0./divdivullia href=http://sourceforge.net/projects/geotools/files/GeoTools%2012%20Releases/12.0/geotools-12.0-bin.zip/download style=color: #ca7900;geotools-12.0-bin.zip/a/lilia href=http://sourceforge.net/projects/geotools/files/GeoTools%2012%20Releases/12.0/geotools-12.0-doc.zip/download style=color: #ca7900;geotools-12.0-doc.zip/a/lilia href=http://sourceforge.net/projects/geotools/files/GeoTools%2012%20Releases/12.0/geotools-12.0-userguide.zip/download style=color: #ca7900;geotools-12.0-userguide.zip/a/lilia href=http://sourceforge.net/projects/geotools/files/GeoTools%2012%20Releases/12-RC1/geotools-12-RC1-project.zip/download style=color: #ca7900;geotools-12.0-project.zip/a/li/ul/divdivGeoTools now ba href=http://docs.geotools.org/latest/userguide/build/install/jdk.htmlrequires Java 7/a /band this is the first release tested with OpenJDK! Please ensure you are using JDK 1.7 or newer for GeoTools 12. Both Oracle Java 7 and OpenJDK 7 are supported, tested, release targets./divdivbr //divdivThere are a number of new features in this release:/divdivul style=text-align: left;li style=margin-left: 15px;span style=font-family: inherit;a href=http://docs.geotools.org/latest/userguide/library/jts/geometry.html#creating-circularstring style=color: #1155cc; target=_blankcircular strings/a are now supported in Oracle data stores, thanks to GeoSolutions.it for the work./span/lili style=margin-left: 15px;span style=font-family: inherit;The a href=http://docs.geotools.org/latest/userguide/tutorial/datastore/index.html style=color: #1155cc; target=_blankcontent datastore tutorial/a was updated by Jody and tested out by the FOSS4G workshop participants./span/lili style=margin-left: 15px;span style=font-family: inherit;GeoTools a href=http://docs.codehaus.org/display/GEOTOOLS/Remove+Assumption+of+org.geotools.filter.FilterFilter interfaces have been simplified/a (cleaning up technical debt from GeoTools 2.3)/span/lili style=margin-left: 15px;span style=font-family: inherit;The new bwfs-ng datastore/b is now available as a drop in replacement for the old WFS datastore, The new store provides much better support for axis orders with servers that don't know what they are doing. In order to make wfs-ng a drop-in replacement (and respond to the same connection parameters) you are blimited to only using one implementation/b of gt-wfs-ng or gt-wfs plugins in your application at a time./span/lili style=margin-left: 15px;span style=font-family: inherit;spanNewb advanced/bb raster reprojection, /b/spanspana lot of work has been put into improving the raster reprojection story for glitches around the date line and polar regions. To enable these options use the following rendering hints:/span/spanbr /span style=font-size: x-small;spanspan style=font-family: 'Courier New', Courier, monospace;rendererParams.put(StreamingRenderer.ADVANCED_PROJECTION_HANDLING_KEY, true);/span/spanbr /spanspan style=font-family: 'Courier New', Courier, monospace;rendererParams.put(StreamingRenderer.CONTINUOUS_MAP_WRAPPING, true);/span/span/span/li/ul/divdivThis release is made in conjunction with a href=http://blog.geoserver.org/2014/10/03/geoserver-2-6-0-released/ target=_blankGeoServer 2.6.0/a and is available from the OSGeo maven repository.br /h3About GeoTools 12/h3/divdivullia href=http://docs.geotools.org/stable/userguide/build/install/jdk.htmlJava 7 required/a (a href=http://docs.codehaus.org/display/GEOTOOLS/Upgrade+master+to+Java+7details/a)/lilia href=http://docs.geotools.org/latest/userguide/tutorial/datastore/index.htmlContentDataStore Tutorial/a/lilia href=http://geotoolsnews.blogspot.ca/2014/05/filter-cleanup-and-ecql-fixes.htmlFilter Cleanup and ECQL Fixes/a (a href=http://docs.codehaus.org/display/GEOTOOLS/Remove+Assumption+of+org.geotools.filter.Filterdetails/a)/lilia href=http://geotoolsnews.blogspot.com/2014/09/maven-snapshot-repository.htmlNew SNAPSHOT repository/a/lilia href=http://www.geo-solutions.it/blog/developers-corner-advanced-raster-projection-geoserver/Advanced Raster Projection/a (GeoSolutions)/li/ul/div/div
Categories: OSGeo Planet

Margherita Di Leo: Call For papers Geospatial devroom @FOSDEM

OSGeo Planet - Mon, 2014-10-20 12:21
div class=separator style=clear: both; text-align: center;a href=http://2.bp.blogspot.com/-QObO980NB70/VET7swJVS0I/AAAAAAAAAjM/pS0mCI9Emc4/s1600/1623644_10203203199988824_1910925809_n.jpg style=margin-left: 1em; margin-right: 1em;img border=0 height=240 src=http://2.bp.blogspot.com/-QObO980NB70/VET7swJVS0I/AAAAAAAAAjM/pS0mCI9Emc4/s1600/1623644_10203203199988824_1910925809_n.jpg width=320 //a/divdiv class= id=magicdomid2 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid3 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid4 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iPlease forward!/i/span/divdiv class= id=magicdomid5 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid6 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;ba href=https://fosdem.org/2015/FOSDEM/a/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; is a free open source event bringing together about 5000 developers in Brussels, Belgium. The goal is to provide open source software developers and communities a place to meet at. The next edition will take place the weekend 31/1 -gt; 1/2/2015. This year for the first time there will be a /spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;bgeospatial devroom/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; on Sunday 1/2/2015!/span/divdiv class= id=magicdomid7 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid8 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Geospatial technology becomes more and more part of mainstream IT. The idea is to bring together people with different backgrounds to better explain and understand the opportunities Geospatial can offer. This devroom will host topics explaining the state of the art of geospatial technology, and how it can be used amongst other projects./span/divdiv class= id=magicdomid9 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid10 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;The /spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;bgeospatial devroom/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; is the place to talk about open, geo-related data and software and their ecosystem. This includes standards and tools, e.g. for spatial databases, and online mapping, geospatial services, used for collecting, storing, delivering, analysing, and visualizing puposes. Typical topics that will be covered are:/span/divdiv class= id=magicdomid11 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid12 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Web and desktop GIS applications/span/li/ul/divdiv class= id=magicdomid13 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Interoperable geospatial web services and specifications/span/li/ul/divdiv class= id=magicdomid14 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Collection of data using sensors/drones/satellites/span/li/ul/divdiv class= id=magicdomid15 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Open hardware for geospatial applications/span/li/ul/divdiv class= id=magicdomid16 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Geo-analytic algorithms/libraries/span/li/ul/divdiv class= id=magicdomid17 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Geospatial extensions for classical databases (indexes, operations)/span/li/ul/divdiv class= id=magicdomid18 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;ul class=list-bullet1 style=margin: 0px 0px 0px 1.5em; padding: 0px;li style=margin: 0px; padding: 0px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Dedicated databases/span/li/ul/divdiv class= id=magicdomid19 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid20 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;bHOW TO SUBMIT YOUR TALK PROPOSAL/b/span/divdiv class= id=magicdomid21 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid22 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Are you thrilled to present your work to other open source developers? Would you like to run a discussion? Any other ideas? Please submit your proposal at the Pentabarf event planning tool at:/span/divdiv class= id=magicdomid23 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid24 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= url style=cursor: auto; padding-bottom: 1px; padding-top: 1px;a href=https://penta.fosdem.org/submission/FOSDEM15 style=cursor: pointer !important;https://penta.fosdem.org/submission/FOSDEM15/a/span/divdiv class= id=magicdomid25 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid26 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;When submitting your talk in Pentabarf, make sure to select the /spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;b'Geospatial devroom' /b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;as  'Track'. Please /spanspan class=b i u style=cursor: auto; padding-bottom: 1px; padding-top: 1px;biuspecify/u/i/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; in the notes if you prefer for your presentation a /spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;bshort timeslot/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; (lightning talks ~10 minutes) or a /spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;blong timeslot/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; (20 minutes presentation + discussion)./span/divdiv class= id=magicdomid27 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid28 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;The /spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;bDEADLINE/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px; for submissions is **/spanspan class=b style=cursor: auto; padding-bottom: 1px; padding-top: 1px;b1st December 2014/b/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;**/span/divdiv class= id=magicdomid29 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid30 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;Should you have any questions, please do not hesitate to get in touch with the organisers of the devroom at /spanspan class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;ifosdem-geospatial@gisky.be/i/spanspan class= style=cursor: auto; padding-bottom: 1px; padding-top: 1px;!/span/divdiv class= id=magicdomid31 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;br //divdiv class= id=magicdomid32 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iJohan Van de Wauw/i/span/divdiv class= id=magicdomid33 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iMargherita Di Leo/i/span/divdiv class= id=magicdomid34 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iAstrid Emde/i/span/divdiv class= id=magicdomid35 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iAnne Ghisla/i/span/divdiv class= id=magicdomid36 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iJulien Fastré/i/span/divdiv class= id=magicdomid37 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iMartin Hammitzsch/i/span/divdiv class= id=magicdomid38 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iAndy Petrella /i/span/divdiv class= id=magicdomid39 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iDirk Frigne/i/span/divdiv class= id=magicdomid40 style=font-family: Arial, sans-serif; font-size: 13px; line-height: 17px; padding-right: 1px;span class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;iGael Musquet/i/span/divdivspan class=i style=cursor: auto; padding-bottom: 1px; padding-top: 1px;ibr //i/span/div
Categories: OSGeo Planet

Jackie Ng: GovHack 2014 post-mortem

OSGeo Planet - Mon, 2014-10-20 10:51
bUPDATE 20 October 2014: a href=http://themapguyde.blogspot.com.au/2014/09/docker-izing-mapguide.htmlAfter a bungle on my Amazon EC2 instance/a, the demo URL on a href=http://hackerspace.govhack.org/content/crash-testour hackerspace project page/a is no longer active. I've resurrected this site on my demo server on Rackspace a href=http://bit.ly/1zhHtDmhere/a. Ignore the link on the hackerspace page until that page gets updated (if it will get updated, because I can't do it)/bbr /br /Earlier this month, I attended the a href=http://www.govhack.org/GovHack 2014/a hackathon, along with thousands of other fellow hackers all across the country. This was my first GovHack, but not my first hackathon. My previous hackathon was a href=http://www.rhok.org/RHoK/a and having no idea how GovHack would turn out, I entered the GovHack event with a RHoK-based mindset of how I would expect this hackathon to turn out.br /br /Bad idea.br /br /I learned very quickly there was a major difference between RHoK and GovHack. Going into RHoK, you have an idea about what solutions you will get to hack on over the weekend as problem owners are present to pitch their ideas to the audience of prospective hackers. With GovHack, you bneed an idea/b about what solution you want to hack on over the weekend, all they were going to provide was the various open data and APIs. What on earth are we going to build?br /br /div class=separator style=clear: both; text-align: center;a href=http://2.bp.blogspot.com/-kOB0X88Rpmg/U9dT52xNlYI/AAAAAAAAFzM/dFLLfuAzjvU/s1600/14449375768_d214622152_b.jpg style=margin-left: 1em; margin-right: 1em;img border=0 height=263 src=http://2.bp.blogspot.com/-kOB0X88Rpmg/U9dT52xNlYI/AAAAAAAAFzM/dFLLfuAzjvU/s1600/14449375768_d214622152_b.jpg width=400 //a/divbr /br /So after losing nearly half the weekend to a href=http://en.wikipedia.org/wiki/Analysis_paralysisanalysis paralysis/a, our team (named CreativeDrought, wonder why?) agreed with my suggestion of just building a a href=http://mapguide.osgeo.org/MapGuide/a-based mashup of various open datasets, most notably, the a href=http://www.data.vic.gov.au/raw_data/crash-stats-data-extract/7752VicRoads Crash Stats dataset/a and related transportation data. I obviously knew MapGuide inside-and-out and its capabilities to have a level of confidence that with the remaining weekend we should still be able to crank out some sort of workable solution. At the very least, we'd have a functional interactive map with some open data on it.br /br /And that's the story of our CrashTest solution in a nutshell. It's a a href=http://trac.osgeo.org/fusion/Fusion/a application, packed to the gills with out-of-the-box functionality from its rich array of widgets (including a href=http://themapguyde.blogspot.com.au/2013/01/mapguide-open-source-25-whats-new.htmlGoogle StreetView/a integration). The main objective of this solution was to allow users to view and analyse crash data, sliced and diced along various age, gender, vehicle type and various socio-economic parameters.br /br /div class=separator style=clear: both; text-align: center;a href=http://3.bp.blogspot.com/-LuUyEpSpDmY/U9Z5PAHTz2I/AAAAAAAAFys/Z_x6OOsJ2A8/s1600/Capture.PNG style=margin-left: 1em; margin-right: 1em;img border=0 height=481 src=http://3.bp.blogspot.com/-LuUyEpSpDmY/U9Z5PAHTz2I/AAAAAAAAFys/Z_x6OOsJ2A8/s1600/Capture.PNG width=640 //a/divbr /br /MapGuide's rich out-of-the-box capabilities, a href=http://trac.osgeo.org/mapguide/wiki/maestroMaestro's/a rapid authoring functionality and a href=http://www.gdal.org/GDAL/OGR's/a ubiquitous data support greatly helped us. I knew with this trio of tools, that we could assemble an application together in the remaining day and a bit left that we had to actually hack on something.br /br /Sadly, we only got as far as putting the data on the map for the most part. Our team spent more time frantically trying to massage various datasets via a href=http://www.gdal.org/ogr2ogr.htmlogr2ogr/a/Excel/GoogleDocs into something more usable than actually writing lines of code! Seriously VicRoads? Pseudo-AMG? Thank goodness a href=http://nyalldawson.net/2013/05/vicroads-and-pseudo-amg/I found the necessary proj4 string/a for this cryptic coordinate system so that we could re-project a fair chunk of the VicRoads spatial data into a coordinate system that better reflects the world we want to mash this data up with!br /br /Still, our solution should hopefully still open up a lot of what if scenarios. Imagine looking at a cluster of accident events, not being able to ascertain any real patterns or correlation and so you then fire up the StreetView widget and lo-and-behold, Google StreetView providing additional insights that a birds-eye view could not. Also imagine the various reporting and number crunching possibilities that are available by tapping into the MapGuide API. Imagine what other useful information you could derive if we had more time to put up additional useful datasets. We didn't get very far on any of the above ideas, so just a href=https://www.youtube.com/watch?v=XLgYAHHkPFsimagine/a such possibilities if you will :)br /br /a href=http://hackerspace.govhack.org/content/crash-testSo here's our entry page/a if you want to have a look. It includes a working demo URL to a a href=http://aws.amazon.com/ec2/Amazon EC2/a hosted instance of MapGuide. Getting acquainted with a href=http://aws.amazon.com/Amazon Web Services/a and putting MapGuide up there was an interesting exercise and much easier than I thought it would be, though I didn't have enough time to use the AWS credits I redeemed over the weekend to momentarily lift this demo site out of the free usage tier range performance-wise. Still, the site seems to perform respectably well on the free usage tier.br /br /Also on that page is a link to a short video where we talk about the hack. Please excuse the sloppy editing, it was obviously recorded in haste in a race against time. Like the solution and/or the possibilities it can offer? Be sure to vote on our entry page.br /br /Despite the initial setbacks, I was happy with what we produced given the severely depleted time constraints imposed on us. I think we got some nice feedback demo-ing CrashTest in person at the post-mortem event several days later, which is always good to hear. Good job team!br /br /div class=separator style=clear: both; text-align: center;a href=http://2.bp.blogspot.com/-UPlDtoEK3HM/U9dbCZeu0zI/AAAAAAAAFzo/lhYlMLGEHaU/s1600/14449221799_58ce613669_z.jpg style=margin-left: 1em; margin-right: 1em;img border=0 height=265 src=http://2.bp.blogspot.com/-UPlDtoEK3HM/U9dbCZeu0zI/AAAAAAAAFzo/lhYlMLGEHaU/s1600/14449221799_58ce613669_z.jpg width=400 //a/divdiv class=separator style=clear: both; text-align: center;br //divSo what do I think could be improved with GovHack?br /ulliHave a list of hack ideas (by participants who actually have some ideas) up bsome time before the hackathon starts/b. This would facilitate team building, letting participants with the skills, but without ideas easily gravitate towards people/teams with the ideas./liliThe mandatory video requirement for each hack entry just doesn't work in its current form. Asking teams to produce their own videos puts lots of unnecessary stress on teams, who not only have to come up with the content for their video, but have to also deal with the logistics of producing said video. I would strongly prefer that teams who can/want to make their own video do so, while other teams can just do a lt;= 3 minute presentation and have that be recorded by the GovHack organisers. Presentations also lets teams find out how other teams fared over the weekend. While everyone else in the a href=http://www.thoughtworks.com/ThoughtWorks/a Melbourne office was counting down to the end of the hackathon, I was still frantically trying to record my lines and trying not to flub them! I raided the office fridge for whatever free booze that remained just to calm myself down afterwards. I don't want to be in that situation ever again!/liliFinally, the data itself. So many spatial datasets as CSV files! So many datasets with no coordinates, but have addresses, horribly formatted addresses, adding even more hoops to geocode them. KML/KMZ may be a decent consumer format, but it is a terrible bdata source/b format. If ogr2ogr can't convert your dataset, and requires a manual intervention of a href=http://qgis.org/en/site/QGIS/a to fix it, then perhaps it's better to use a different spatial data format. Despite my loathing of its limitations, SHP files would've been heavily preferred for all of the above cases. a href=https://www.formstack.com/forms/?1784394-5uYfNFlmeBI've made my thoughts known on the GovHack DataRater/a about the quality of some of these datasets we had to deal with and got plenty of imaginary ponies in the process./li/ulDespite the above points, the event as a whole was a lot of fun. Thanks to the team (Jackie and Felicity) for your data wrangling and video production efforts.br /br /div class=separator style=clear: both; text-align: center;a href=http://1.bp.blogspot.com/-Az2bP7Wi7Ns/U9dVsg8eZDI/AAAAAAAAFzY/rJnd0TyjECw/s1600/14466411978_9a6eab0c3c_z.jpg style=margin-left: 1em; margin-right: 1em;img border=0 height=265 src=http://1.bp.blogspot.com/-Az2bP7Wi7Ns/U9dVsg8eZDI/AAAAAAAAFzY/rJnd0TyjECw/s1600/14466411978_9a6eab0c3c_z.jpg width=400 //a/divbr /Also thanks to Jordan Wilson-Otto and a href=https://www.flickr.com/photos/125335438@N04/sets/72157645234649750/his flickr photostream/a where I was able to get some of these photos for this particular post.br /br /Would I be interested in attending the 2015 edition of GovHack? Given I am now armed with 20/20 hindsight, yes I would!
Categories: OSGeo Planet

Petr Pridal: IIIF for images in culture heritage

OSGeo Planet - Mon, 2014-10-20 08:59
div dir=ltr style=text-align: left;div class=separator style=clear: both; text-align: center;a href=http://4.bp.blogspot.com/-ljvxHRaQ8ow/VEQTpcEVhvI/AAAAAAAAZAE/TATGcJNZT5U/s1600/Screen%2BShot%2B2014-10-19%2Bat%2B21.39.45.png style=clear: right; float: right; margin-bottom: 1em; margin-left: 1em;img border=0 src=http://4.bp.blogspot.com/-ljvxHRaQ8ow/VEQTpcEVhvI/AAAAAAAAZAE/TATGcJNZT5U/s1600/Screen%2BShot%2B2014-10-19%2Bat%2B21.39.45.png //a/divbr /Online scans of culture heritage documents, such as old maps, books, photographs, etc. are being published by the galleries, libraries, archives and museums.  Until now there was no official standardisation activity in this area. This is now changing with the International Image Interoperability Framework IIIF (a href=http://iiif.io/http://iiif.io//a), which enables easy access to large raster images across institutions.br /divbr //divdivbWe are happy to announce a new Open Source IIIF viewer, with several useful features: /bbr /br //divdivdiv- Rotation on client side  - pinch with fingers, Alt-Shift drag with the mouse/divdiv- Drawing tools - polygons, lines, markers - used to annotate parts of the pictures/divdiv- Color adjustments - saturation, lightness, etcbr /br /div style=text-align: center;br class=Apple-interchange-newline //divdiv class=separator style=clear: both; text-align: center;Demo available at: a href=http://klokantech.github.io/iiifviewer/ style=text-align: left;http://klokantech.github.io/iiifviewer//a/divbr /The viewer is pure Java Script, mobile optimised with almost native feeling for zoom and powered by OpenLayers V3 open-source project, where we are co-developers (see a href=http://blog.klokantech.com/2012/06/openlayers-v3-sprint-event.html target=_blankblog post/a).br /br /Feel free to try at: a href=http://klokantech.github.io/iiifviewer/http://klokantech.github.io/iiifviewer//abr /div style=text-align: center;br //div/div/divdivdiv/divSource codes are available on GitHub: a href=https://github.com/klokantech/iiifviewer/https://github.com/klokantech/iiifviewer//abr /br //divdivThis viewer is another important part of the mosaic of open source tools for publishing of large images and maps. Together with high-performance open-source JPEG2000 image server can be used to serve thousands of users in a very fast and efficient way.br /br /The mentioned server providing IIIF endpoint for the JPEG2000 images was developed and released by Klokan Technologies in cooperation with the National Library of Austria and their Google Books scanning project, the a href=http://blog.klokantech.com/2013/11/the-austrian-national-library-first.html target=_blankAustrian Books in 2013/a. The documentation is available at: a href=https://github.com/klokantech/iiifserver/https://github.com/klokantech/iiifserver//a/divdivbr //divdivServer software runs under Linux, Mac OS X as well as Windows. There is even an easy to use a href=https://github.com/klokantech/iiifserver/releases target=_blankinstaller/a.  It is powered by IIPImage server and our code has been recently refactored and merged back to the main IIPImage repository.br /br /Support and maintenance for installation of this open-source software can be provided by Klokan as well as the access to JPEG2000 Kakadu license./div/divimg height=1 src=http://feeds.feedburner.com/~r/klokan-blog-osgeo/~4/c52S9JO0r2w width=1 /
Categories: OSGeo Planet

Sean Gillies: Unix style spatial ETL with fio cat, collect, and load

OSGeo Planet - Sun, 2014-10-19 14:46
div class=section id=unix-style-spatial-etl-with-fio-cat-collect-and-load h1Unix style spatial ETL with fio cat, collect, and load/h1 pIn Fiona 1.4.0 I added a fio-cat command to the CLI which works much UNIX cat. It opens one or more vector datastets, concatenating their features and printing them to stdout as a sequence of GeoJSON features./p div class=highlight-consolediv class=highlightprespan class=gp$/span fio cat docs/data/test_uk.shp | head -n 2 span class=go{geometry: {coordinates: [...], type: Polygon}, id: 0, properties: {AREA: 244820.0, CAT: 232.0, CNTRY_NAME: United Kingdom, FIPS_CNTRY: UK, POP_CNTRY: 60270708.0}, type: Feature}/span span class=go{geometry: {coordinates: [...], type: Polygon}, id: 1, properties: {AREA: 244820.0, CAT: 232.0, CNTRY_NAME: United Kingdom, FIPS_CNTRY: UK, POP_CNTRY: 60270708.0}, type: Feature}/span /pre/div /div pI’ve replaced most of the coordinates with ellipses to save space in the code block above, something I’ll continue to do in examples below./p pI said that fio-cat concatenates features of multiple files and you can see this by using span class=docutils literalspan class=prewc/span span class=pre-l/span/span./p div class=highlight-consolediv class=highlightprespan class=gp$/span fio cat docs/data/test_uk.shp | wc -l span class=go 48/span span class=gp$/span fio cat docs/data/test_uk.shp docs/data/test_uk.shp | wc -l span class=go 96/span /pre/div /div pIf you look closely at the output, you’ll see that every GeoJSON feature is a standalone text and each is preceded by an ASCII RS (0x1E) control character. These allow you to cat pretty-printed GeoJSON (using the span class=docutils literalspan class=pre--indent/span/span option) containing newlines that can still be understood as a sequence of texts by other programs. Software like Python’s json module and Node’s underscore-cli will trip over unstripped RS, so you can disable the RS control characters and emit LF delimited sequences of GeoJSON (with no option to pretty print, of course) using span class=docutils literalspan class=pre--x-json-seq-no-rs/span/span./p pTo complement fio-cat I’ve written fio-load and fio-collect. They read features from a sequence (RS or LF delimited) and respectively write them to a formatted vector file (such as a Shapefile) or print them as a GeoJSON feature collection./p pHere’s an example of using fio-cat and load together. You should tell fio-load what coordinate reference system to use when writing the output file because that information isn’t carried in the GeoJSON features written by fio-cat./p div class=highlight-consolediv class=highlightprespan class=gp$/span fio cat docs/data/test_uk.shp span class=se\/span span class=go| fio load --driver Shapefile --dst_crs EPSG:4326 /tmp/test_uk.shp/span span class=gp$/span ls -l /tmp/test_uk.* span class=go-rw-r--r-- 1 seang wheel 10 Oct 5 10:09 /tmp/test_uk.cpg/span span class=go-rw-r--r-- 1 seang wheel 11377 Oct 5 10:09 /tmp/test_uk.dbf/span span class=go-rw-r--r-- 1 seang wheel 143 Oct 5 10:09 /tmp/test_uk.prj/span span class=go-rw-r--r-- 1 seang wheel 65156 Oct 5 10:09 /tmp/test_uk.shp/span span class=go-rw-r--r-- 1 seang wheel 484 Oct 5 10:09 /tmp/test_uk.shx/span /pre/div /div pAnd here’s one of fio-cat and collect./p div class=highlight-consolediv class=highlightprespan class=gp$/span fio cat docs/data/test_uk.shp | fio collect --indent 4 | head span class=go{/span span class=go features: [/span span class=go {/span span class=go geometry: {/span span class=go coordinates: [/span span class=go [/span span class=go [/span span class=go 0.899167,/span span class=go 51.357216/span span class=go ],/span span class=gp$/span fio cat docs/data/test_uk.shp | fio collect --indent 4 | tail span class=go CAT: 232.0,/span span class=go CNTRY_NAME: United Kingdom,/span span class=go FIPS_CNTRY: UK,/span span class=go POP_CNTRY: 60270708.0/span span class=go },/span span class=go type: Feature/span span class=go }/span span class=go ],/span span class=go type: FeatureCollection/span span class=go}/span /pre/div /div pDoes it look like I’ve simply reinvented ogr2ogr? The difference is that with fio-cat and fio-load there’s space in between for programs that process features. The programs could be written in any language. They might use Shapely, they might use Turf. The only requirement is that they read and write sequences of GeoJSON features using stdin and stdout. A nice property of programs like these is that you can sometimes parallelize them cheaply using a class=reference external href=http://www.gnu.org/software/parallel/parallel_tutorial.html#pipeGNU parallel/a./p pThe fio-buffer program (a class=reference external href=https://github.com/Toblerity/Fiona/blob/sequence-processing/fiona/fio/ops.pyunreleased/a) in the example below uses Shapely to calculate a 100 km buffer around features (in Web Mercator, I know!). Parallel doesn’t help in this example because the sequence of features from fio-cat is fairly small, but I want to show you how to tell parallel to watch for RS as a record separator./p div class=highlight-consolediv class=highlightprespan class=gp$/span fio cat docs/data/test_uk.shp --dst_crs EPSG:3857 span class=se\/span span class=gpgt;/span | parallel --pipe --recstart span class=s1'\x1E'/span fio buffer 1E+5 span class=se\/span span class=gpgt;/span | fio collect --src_crs EPSG:3857 span class=se\/span span class=gpgt;/span | geojsonio /pre/div /div pHere’s the result. Unix pipelines, still awesome at the age of a class=reference external href=http://en.wikipedia.org/wiki/Pipeline_(Unix)#History41/a!/p pThe other point of this post is that, with the a class=reference external href=https://datatracker.ietf.org/doc/draft-ietf-json-text-sequence/JSON Text Sequence/a draft apparently going to publication, sequences of GeoJSON features not collected into a GeoJSON feature collection are very close to being a real thing that developers should be supporting./p /div
Categories: OSGeo Planet
Syndicate content