Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Notas do Editor
The challenge is to get what you want, from all over the place, without doing much work, and understanding the answer!
( The problem: ) How to deliver information uniformly from heterogeneous sources to various users for different reasons?The data we’re interested in is similar, about the same thing in the real world (e.g. weather info, geology, etc.), but is not exactly the same...It varies from source to source because of the chosen platform, format (...), technology – the way you deliver data to your clients (...), versions of the data (...). - All these aspects are technology related.Now to complicate things even more – what about natural languages? Especially when you’re dealing with multinational communities it becomes a real issue. (dialects, etc...) Any long term solution has to be multilingual.What is even worse is that data access is not standardised not only across organisations but even within the organisation!+ Existing information is commonly incomplete and fragmented across government agencies, each with its own information management systems and structures.And after all it’s not about you – it’s about someone else consuming the information you deliver. This is another part of the problem – do we know what they’re going to use it for, how, by what means? And how to suit them best?
The goal is to suit a variety of users with different agendas, views, aspirations.It’s not about AN application, its about many different kinds of applications, many of which data providers cannot even begin to guess at.These are the only few examples of potential uses of the information delivered via an SDI. Elaborate on each one briefly...
You’re now delivering your valuable datasets but are they useful to others? Do people know about existence of your services that provide all that knowledge? If not it’s really worth nothing!Once you’re got to this point you need a catalogues/register that users can query to find the information they need. To go even further, all these catalogues managed independently by data custodians can be consolidated together via national catalogues, such as Australian National Data Service and Australian Spatial Data Directory that are building a cohesive collection of research resources from all research institutions, to make better use of Australia's research data outputs. These national catalogues are then harvesting from underlying catalogues ensuring quality and consistency of records.
So what is being done in Australia about this?+ AuScope was a response, an organisation building such an infrastructure to support earth science. Funded by a federal government initiative with considerable investment from research organisation and private industry.+ Now we are working with other institutions to bring the technology into other areas, such as weather and climate, that is now funded through the collaboration project with BoM; and social protection in Indonesia through the UNSDI project.Elaborate on layers of the stack. Technology outline.
The interesting aspect about the stack is that even though we recommend and pre-bundle some application as part of the SISS – all of them are interchangeable as they’re all based on international standards. And, in fact, there’re more than one alternative options for each component in the stack.
Talking about currentdeployments of SISS...
There’re quite a few examples of current applications and portals that are backed by the SISS stack. We’re now diversifying the scope and stepping into new areas, such as gazetteer framework for Indonesia (as part of the project jointly funded by Australia’s overseas aid agency AusAID (and climate via the collaboration project with BoM.))Other applications that may consume data delivered by the SISS include various portals, GoogleEarth/Maps, desktop applications, processing codes that run on supercomputers, desktop GIS applications, GPlates and others.
There’re some internationalapplication of the SISS or various parts of it including… (dot points.)
In Australia, what has been achieved so far is the geological data exchange network with multiple deployments in every Australian geological survey and GA.Under AuScope we initially started with deployments in geological surveys providing access to earth resource and borehole information. But now we have numerous nationally distributed deployments that provide access to the information from various science domains. The range of delivered data products now extends from geologic units, geophysics and geothermal data to satellite, groundwater information and beyond.I will also note these are only the deployments of SISS, other deployments of compliant middleware (ie: OGC services) exist at multiple stakeholders, some providing upward of several hundred datasources via WFS or WMS.Blue = AuScopeOrange = ASRDC
Metadata about all these available Australiandatasets is also harvested into national catalogues, such as ANDS and ASDD.
Note – our focus has been on Infrastructures and Deployments, not Portals. Even though the Portal is functional as a DISCOVERY tool, it is by no means complete!You can combine various kinds of data, stored at different places and in different formats and visualise them in your web browser.You can even download them! WFS rich data modelled following Community Agreed Standards such as GeoSciML (CGI WG) or EarthResourceML and encoded in a XML file. And WMS PNG files (bitmap only).
The National Virtual Core Library -> a component of AuScope.
Now for a quick demonstration...
Here is just onenotable example that takes SISS further than just a data discovery infrastructure – VGL developed for GA. This virtual laboratory enables a whole scientific workflow – from data discovery, preparation and submission of the job to monitoring jobs, retrieving results and automated generation of provenance records.--Even GA are taking this change… from product to delivery of data – take the VGL for example….4 key steps in workflow:Discovery of dataPreparation and submission of jobMonitoring and retrieving jobsProvenance (automated)
VGL is not just aboutvisualisation, it’s really about the science. It is more than just a discovery portal! Thecolours are just pretty images on the map; what really matters is the actual data – the numbers behind it that are useful for the science.--Actual data – the numbers are the science.The colours are just pretty!
Now another example – a geospatial gazetteer framework to streamline access to timely, relevant information;And the semantic information management components of the SISS that underpin an initiative in Indonesia, the UNSDI Gazetteer Framework for Social Protection.
Brief Background of ProjectThe UNSDI Gazetteer Framework (for Social Protection in Indonesia Project) aims to develop an infrastructure to improve the integration of information contained within multiple systems. The project is predicated on the assumption that a ‘Gazetteer’ is any geospatial dataset which contains ‘spatial identifiers’ (these can be names or identifiers such as postcodes, census mesh block numbers, asset numbers etc).The research aspects of the project will focus on understanding how information relevant to social protection (for vulnerable communities) might be linked using these spatial identifiers from common, source and application gazetteers. This linking of information will be achieved through the development of a framework which enables datasets to be published, indexed, subscribed to, accessed and compared using a common gazetteer information model to create unique and persistent identifiers.The gazetteer framework is envisaged to provide a mechanism to manage and re-use integrated spatial data which supports a range of humanitarian, development and environmental activities at different scales.-----------(The Gazetteer Project has been jointly developed by CSIRO and the Office of the Chief Information and Technology Officer (CITO) of the UN Secretariat and is a deliverable of the CoE4UNSDI. It has been designed to provide a basis for ongoing development and evolution of the UNSDI. Specifically, it aims to support development of standards and best practice methodologies for provisioning core datasets used within the UN system (by strengthening capacities to create, maintain and publish spatial information.) )
Very large amounts of effort and time are currently spent by governments and non-government agencies discovering, interpreting and integrating data for the purposes of assessment, response and planning. Within Indonesia, a recent report identified that a complex information coordination system was limiting social protection program planning, and that the focus should be shifted to developing robust information sharing systems which would facilitate the work of highly-trained analysts.Often, for the purposes of data testing and quality assurance, geospatially enabled datasets will need to be integrated from source and application gazetteers into a common gazetteer to be utilised by a variety of agencies. A particular challenge in the development of common gazetteers is the interpretation and matching of spatial identifiers across multiple datasets (i.e. testing whether fragmented data sources are referencing the same or different places – a process which requires understanding what the identifiers refer to and their associated feature types).The goal of our R&D team is to design and develop an integration mechanism that will eventually reduce the time and effort required to obtain the data from this... to this [x] to allow decision makers to concentrate more on the actual usage of data. [x]
Explain the example.You may also ask what is the Value? You may know or heard about Harmonisation which would change the underlying data. This implies that there’s something wrong with your data and it usually takes considerable time to harmonise the dataset and to the owner, is rarely worth doing. But this is different.Additional service is providing knowledge link, allowing integration without harmonisation.
Dev – SISS to support WPS, SOS, restful web services, rdf-interfaces etc etcData flows – ensure all custodians we work with, have data available to ANDSCommunity – engage and educate, redundancyImprove the scorecard – see ASRDC plan page 6Deployments – BoM, Geoscience Australia, MDU, VeRSI, DPI Vic, DSE, Uni Ballarat. ABIN etcSelf deployments – VeRSI part of sustainabilityIn the Information Space – move toward Restful services (semantic technologies)In the Computational Space – move toward analytic modules or appliances SISS v3 (June 2012)SOSWPSIntegration between WxS servicesRegistry Solutions SISS v4 (Jan 2013?)WFS2.0+ capability3D capabilityRestful interfaces on OGC servicesModelling Support ToolsDocumentation ManualsUI for ConfigurationAnalytic Support ServicesSISS-in-the-Cloud SISS-lite (get up and running in 5mins)As for applications –More workflows