eResearch workflows for studying free and open source software development

•Transferir como PPT, PDF•

6 gostaram•596 visualizações

1. The document discusses using scientific workflows and tools like Taverna for distributed collaborative research on free and open source software development using large datasets, computational resources, and reproducible analysis. 2. Taverna is presented as an example of a scientific workflow tool that allows modular development of analysis through reusable components with input and output ports, offering advantages over scripts. 3. An example workflow is shown that calculates network centralization in dynamic networks and generates time series and CSV output for further analysis.

Tecnologia Economia e finanças

eResearch workflows for studying free and open source software development James Howison, Andrea Wiggins, & Kevin Crowston Syracuse University School of Information Studies 9 September 2008 ~ IFIP 2.13 - OSS 2008

eResearch ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Current FLOSS Research Practices ,[object Object],[object Object],[object Object],[object Object],[object Object]

FLOSS Research Repositories Java projects plus user contributions Pilot: KDE Partial: Sourceforge, ObjectWeb, Apache, GNOME Sourceforge Sourceforge, Rubyforge, ObjectWeb, Debian, freshmeat Sample collected In Debian Downloads & pageviews Downloads, pageviews, ratings, in Debian, partial: actual use Use & popularity Size & complexity metrics Planned/pilot: size & complexity metrics SVN/CVS full, size, packages, releases & dates SVN/CVS count, packages, releases & dates SVN/CVS count, packages, releases & dates Software venues Planned/pilot: mail lists & trackers Forums & trackers Releases; in progress: mail lists, forums, trackers Communication venues Memberships & roles Memberships & roles Memberships & roles Developer demographics Basic data & confirmed locations Basic data Basic data Project Demographics Source kibitzer Qualoss & SQO-OSS FLOSSmetrics & CVSAnalY SRDA (Notre Dame) FLOSSmole

Scientific Workflow Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why Workflows Instead of Scripts? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Taverna Workbench ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Workflow Component Types ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example Workflow ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example Output ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Benefits of Using Workflows ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mais conteúdo relacionado

Semelhante a eResearch workflows for studying free and open source software development

Collaborative Data Analysis with Taverna Workflows

Andrea Wiggins

Replicating FLOSS Research as eResearch

Andrea Wiggins

Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...

Baden Hughes

Advances in Scientific Workflow Environments

Carole Goble

Lviv Data Science Club (Sergiy Lunyakin)

Lviv Startup Club

sudoers: Benchmarking Hadoop with ALOJA

Nicolas Poggi

Taverna workflows: provenance and reproducibility - STFC/NERC workshop 2013

anpawlik

ODSC East virtual presentation - The best machine learning, and advanced analytics projects are often stopped when it comes time to move into large scale production, preventing them from ever impacting the business in a meaningful way. Hundreds of hours of work may never get put to use. Python is rapidly becoming the language of choice for scientists and researchers of many types to build, test, train and score models. But when data science models need to go into production, challenges of performance and scale can be a huge roadblock. By combining a Python application with an underlying massively parallel (MPP) database, Python users can achieve a simplified path to production. An MPP database also allows you to do data preparation and data analysis at far greater speeds, accelerating development and testing as well as production performance. It also allows greater numbers of concurrent jobs to run, while also continuously loading data for IoT or other streaming use cases. Analyze data in the database where it sits, rather than first moving it to another framework, then analyzing it, then moving the results, taking multiple performance hits from both CPU and IO for every move and transformation. In this talk, you will learn about combination architectures that can get your work into production, shorten development time, and provide the performance and scale advantages of an MPP database with the convenience and power of Python. Use case examples use the open source Vertica-Python project created by Uber with contributions from Twitter, Palantir, Etsy, Vertica, Kayak and Gooddata.

Python + MPP Database = Large Scale AI/ML Projects in Production Faster

Paige_Roberts

Source-to-source transformations: Supporting tools and infrastructure

kaveirious

Versioning for Workflow Evolution

Eran Chinthaka Withana

3rd presentation

Olabode Ajayi

German Conference on Bioinformatics 2021 https://gcb2021.de/ FAIR Computational Workflows Computational workflows capture precise descriptions of the steps and data dependencies needed to carry out computational data pipelines, analysis and simulations in many areas of Science, including the Life Sciences. The use of computational workflows to manage these multi-step computational processes has accelerated in the past few years driven by the need for scalable data processing, the exchange of processing know-how, and the desire for more reproducible (or at least transparent) and quality assured processing methods. The SARS-CoV-2 pandemic has significantly highlighted the value of workflows. This increased interest in workflows has been matched by the number of workflow management systems available to scientists (Galaxy, Snakemake, Nextflow and 270+ more) and the number of workflow services like registries and monitors. There is also recognition that workflows are first class, publishable Research Objects just as data are. They deserve their own FAIR (Findable, Accessible, Interoperable, Reusable) principles and services that cater for their dual roles as explicit method description and software method execution [1]. To promote long-term usability and uptake by the scientific community, workflows (as well as the tools that integrate them) should become FAIR+R(eproducible), and citable so that author’s credit is attributed fairly and accurately. The work on improving the FAIRness of workflows has already started and a whole ecosystem of tools, guidelines and best practices has been under development to reduce the time needed to adapt, reuse and extend existing scientific workflows. An example is the EOSC-Life Cluster of 13 European Biomedical Research Infrastructures which is developing a FAIR Workflow Collaboratory based on the ELIXIR Research Infrastructure for Life Science Data Tools ecosystem. While there are many tools for addressing different aspects of FAIR workflows, many challenges remain for describing, annotating, and exposing scientific workflows so that they can be found, understood and reused by other scientists. This keynote will explore the FAIR principles for computational workflows in the Life Science using the EOSC-Life Workflow Collaboratory as an example. [1] Carole Goble, Sarah Cohen-Boulakia, Stian Soiland-Reyes,Daniel Garijo, Yolanda Gil, Michael R. Crusoe, Kristian Peters, and Daniel Schober FAIR Computational Workflows Data Intelligence 2020 2:1-2, 108-121 https://doi.org/10.1162/dint_a_00033.

FAIR Computational Workflows

Carole Goble

In this session I'd share the design, architecture and implementation of some of the most common elements of any social platform - Open API, profiles, searches, lists and activity streams. These "pillers" of a social platform bear most of the weight behind a jazzy UI, and scaling them has its own challenges. I will also talk about how we built the Social Platform at IGN from ground up, including not-so-unique challenges like integration with legacy systems.

Silicon Valley Code Camp 2010: Social Platforms : What goes on under the hood

Manish Pandit

Sparkflows.io

sparkflows

Development Practices & The Microsoft Approach

Steve Lange

Apache phoenix

University of Moratuwa

The Taverna Software Suite

myGrid team

The Chemtools LaBLog

Cameron Neylon

Many of the Big Data and IoT use cases are based on combining data from multiple data sources and to make them available on a Big Data platform for analysis. The data sources are often very heterogeneous, from simple files, databases to high-volume event streams from sensors (IoT devices). It’s important to retrieve this data in a secure and reliable manner and integrate it with the Big Data platform so that it is available for analysis in real-time (stream processing) as well as in batch (typical big data processing). In past some new tools have emerged, which are especially capable of handling the process of integrating data from outside, often called Data Ingestion. From an outside perspective, they are very similar to a traditional Enterprise Service Bus infrastructures, which in larger organization are often in use to handle message-driven and service-oriented systems. But there are also important differences, they are typically easier to scale in a horizontal fashion, offer a more distributed setup, are capable of handling high-volumes of data/messages, provide a very detailed monitoring on message level and integrate very well with the Hadoop ecosystem. This session will present and compare Apache Flume, Apache NiFi, StreamSets and the Kafka Ecosystem and show how they handle the data ingestion in a Big Data solution architecture.

Self-Service Data Ingestion Using NiFi, StreamSets & Kafka

Guido Schmutz

DataFinder: A Python Application for Scientific Data Management

Andreas Schreiber

Semelhante a eResearch workflows for studying free and open source software development (20)

Collaborative Data Analysis with Taverna Workflows

Replicating FLOSS Research as eResearch

Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...

Advances in Scientific Workflow Environments

Lviv Data Science Club (Sergiy Lunyakin)

sudoers: Benchmarking Hadoop with ALOJA

Taverna workflows: provenance and reproducibility - STFC/NERC workshop 2013

Python + MPP Database = Large Scale AI/ML Projects in Production Faster

Source-to-source transformations: Supporting tools and infrastructure

Versioning for Workflow Evolution

3rd presentation

FAIR Computational Workflows

Silicon Valley Code Camp 2010: Social Platforms : What goes on under the hood

Sparkflows.io

Development Practices & The Microsoft Approach

Apache phoenix

The Taverna Software Suite

The Chemtools LaBLog

Self-Service Data Ingestion Using NiFi, StreamSets & Kafka

DataFinder: A Python Application for Scientific Data Management

Mais de Andrea Wiggins

Online Communities in Citizen Science & BirdCams

Andrea Wiggins

Free as in Puppies: Compensating for ICT Constraints in Citizen Science

Andrea Wiggins

Crowdsourcing Citizen Science Data Quality with a Human-Computer Learning Net...

Andrea Wiggins

Online Communities in Citizen Science

Andrea Wiggins

Citizen Science Phenotypes

Andrea Wiggins

The Evolving Landscape of Citizen Science

Andrea Wiggins

Citizen Science 101: What Every Researcher Should Know About Crowdsourcing Sc...

Andrea Wiggins

Data Management for Citizen Science

Andrea Wiggins

With Great Data Comes Great Responsibility

Andrea Wiggins

Crowdsourcing Scientific Work: A Comparative Study of Technologies, Processes...

Andrea Wiggins

Mechanisms for Data Quality and Validation in Citizen Science

Andrea Wiggins

Open Source & Citizen Science

Andrea Wiggins

From Conservation to Crowdsourcing: A Typology of Citizen Science

Andrea Wiggins

Motivation by Design: Technologies, Experiences, and Incentives

Andrea Wiggins

Data Intensive Collaboration in Science and Engineering: CSCW workshop themes

Andrea Wiggins

Secondary data analysis with digital trace data

Andrea Wiggins

Open Source, Open Science, & Citizen Science

Andrea Wiggins

Reclassifying Success and Tragedy in FLOSS Projects

Andrea Wiggins

Crowdsourcing Science

Andrea Wiggins

Intellectual Diversity in the iSchools: Past, Present and Future

Andrea Wiggins

Mais de Andrea Wiggins (20)

Online Communities in Citizen Science & BirdCams

Free as in Puppies: Compensating for ICT Constraints in Citizen Science

Crowdsourcing Citizen Science Data Quality with a Human-Computer Learning Net...

Online Communities in Citizen Science

Citizen Science Phenotypes

The Evolving Landscape of Citizen Science

Citizen Science 101: What Every Researcher Should Know About Crowdsourcing Sc...

Data Management for Citizen Science

With Great Data Comes Great Responsibility

Crowdsourcing Scientific Work: A Comparative Study of Technologies, Processes...

Mechanisms for Data Quality and Validation in Citizen Science

Open Source & Citizen Science

From Conservation to Crowdsourcing: A Typology of Citizen Science

Motivation by Design: Technologies, Experiences, and Incentives

Data Intensive Collaboration in Science and Engineering: CSCW workshop themes

Secondary data analysis with digital trace data

Open Source, Open Science, & Citizen Science

Reclassifying Success and Tragedy in FLOSS Projects

Crowdsourcing Science

Intellectual Diversity in the iSchools: Past, Present and Future

Último

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Navi Mumbai Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Navi Mumbai Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Navi Mumbai Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

Modernizing Securities Finance: The cloud-native prime brokerage platform transforming capital markets. Madhu Subbu, Managing Director, Head of Securities Finance Engineering Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

apidays

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

DBX First Quarter 2024 Investor Presentation

Dropbox

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

AXA XL - Insurer Innovation Award Americas 2024

The Digital Insurer

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

eResearch workflows for studying free and open source software development

1. eResearch workflows for studying free and open source software development James Howison, Andrea Wiggins, & Kevin Crowston Syracuse University School of Information Studies 9 September 2008 ~ IFIP 2.13 - OSS 2008

4. FLOSS Research Repositories Java projects plus user contributions Pilot: KDE Partial: Sourceforge, ObjectWeb, Apache, GNOME Sourceforge Sourceforge, Rubyforge, ObjectWeb, Debian, freshmeat Sample collected In Debian Downloads & pageviews Downloads, pageviews, ratings, in Debian, partial: actual use Use & popularity Size & complexity metrics Planned/pilot: size & complexity metrics SVN/CVS full, size, packages, releases & dates SVN/CVS count, packages, releases & dates SVN/CVS count, packages, releases & dates Software venues Planned/pilot: mail lists & trackers Forums & trackers Releases; in progress: mail lists, forums, trackers Communication venues Memberships & roles Memberships & roles Memberships & roles Developer demographics Basic data & confirmed locations Basic data Basic data Project Demographics Source kibitzer Qualoss & SQO-OSS FLOSSmetrics & CVSAnalY SRDA (Notre Dame) FLOSSmole

5. FLOSS Research Today

6. FLOSS Research Tomorrow?

10. Taverna Design Mode

11. Taverna Execution Mode

12.

13.

14.

15.

16.

17.