MemGator - A Memento Aggregator CLI and Server in Go

•

1 gostou•564 visualizações

MemGator - A Portable Concurrent Memento Aggregator CLI and Server Written in Go. The corresponding poster can be found at http://www.cs.odu.edu/~salam/presentations/memgator-jcdl16-poster.pdf

Software

MemGator
A Memento Aggregator CLI and Server in Go
Sawood Alam @ibnesayeed
Department of Computer Science, Old Dominion University, Norfolk, Virginia - 23529

➢ https://github.com/oduwsdl/memgator
➢ https://hub.docker.com/r/ibnesayeed/memgator/
➢ https://github.com/ibnesayeed/MemGatorTTY
➢ https://hub.docker.com/r/ibnesayeed/memgatortty/
➢ http://memgator.cs.odu.edu/
➢ http://ws-dl.blogspot.com/search/label/MemGator
➢ http://tools.ietf.org/html/rfc7089
➢ http://timetravel.mementoweb.org/guide/api
References

Mais conteúdo relacionado

Mais de Sawood Alam

Profiling Web Archival Voids for Memento Routing

Sawood Alam

Readying Web Archives to Consume and Leverage Web Bundles

Sawood Alam

Summarize Your Archival Holdings With MementoMap

Sawood Alam

MementoMap: A Web Archive Profiling Framework for Efficient Memento Routing

Sawood Alam

We describe challenges related to web archiving, replaying archived web resources, and verifying their authenticity. We show that Web Packaging has significant potential to help address these challenges and identify areas in which changes are needed in order to fully realize that potential. Position Paper: https://arxiv.org/abs/1906.07104 Presented in the Internet Architecture Board's ESCAPE 2019 Workshop (Exploring Synergy between Content Aggregation and the Publisher Ecosystem) https://www.iab.org/activities/workshops/escape-workshop/

Supporting Web Archiving via Web Packaging

Sawood Alam

MementoMap: An Archive Profile Dissemination Framework

Sawood Alam

Certain HTTP Cookies on certain sites can be a source of content bias in archival crawls. Accommodating Cookies at crawl time, but not utilizing them at replay time may cause cookie violations, resulting in defaced composite mementos that never existed on the live web. To address these issues, we propose that crawlers store Cookies with short expiration time and archival replay systems account for values in the Vary header along with URIs.

Impact of HTTP Cookie Violations in Web Archives

Sawood Alam

The number of public and private web archives has increased, and we implicitly trust content delivered by these archives. Fixity is checked to ensure an archived resource has remained unaltered since the time it was captured. Some web archives do not allow users to access fixity information and, more importantly, even if fixity information is available, it is provided by the same archive from which the archived resources are requested. In this research, we propose two approaches, namely Atomic and Block, to establish and check fixity of archived resources.

Archive Assisted Archival Fixity Verification Framework

Sawood Alam

In this work we propose MementoMap, a flexible and adaptive framework to efficiently summarize holdings of a web archive. We described a simple, yet extensible, file format suitable for MementoMap. We used the complete index of the arquivo.pt comprising 5B mementos (archived web pages/files) to understand the nature and shape of its holdings. We generated MementoMaps with varying amount of detail from its HTML pages that have an HTTP status code of 200 OK. Additionally, we designed a single-pass, memory-efficient, and parallelization-friendly algorithm to compact a large MementoMap into a small one and an in-file binary search method for efficient lookup. We analyzed more than three years of MemGator (a Memento aggregator) logs to understand the response behavior of 14 public web archives. We evaluated MementoMaps by measuring their Accuracy using 3.3M unique URIs from MemGator logs. We found that a MementoMap of less than 1.5% Relative Cost (as compared to the comprehensive listing of all the unique original URIs) can correctly identify the presence or absence of 60% of the lookup URIs in the corresponding archive while maintaining 100% Recall (i.e., zero false negatives).

MementoMap Framework for Flexible and Adaptive Web Archive Profiling

Sawood Alam

Web ARChive (WARC) File Format

Sawood Alam

InterPlanetary Wayback (IPWB) facilitates permanence and collaboration in web archives by disseminating the contents of WARC files into the InterPlanetary File System (IPFS) network. IPFS is a peer-to-peer content-addressable file system that inherently allows deduplication and facilitates opt-in replication. IPWB splits the header and payload of WARC response records before disseminating into IPFS to leverage the deduplication, builds a CDXJ index with references to the IPFS hashes returns, and combines the headers and payload from IPFS at the time of replay. We also explore the possibility of an index-free, fully decentralized collaborative web archiving system as the next step.

InterPlanetary Wayback: The Next Step Towards Decentralized Web Archiving

Sawood Alam

Avoiding Zombies in Archival Replay Using ServiceWorker

Sawood Alam

Client-side Reconstruction of Composite Mementos Using ServiceWorker

Sawood Alam

TPDL 2016 Doctoral Consortium - Web Archive Profiling

Sawood Alam

Introducing Web Archiving and WSDL Research Group

Sawood Alam

InterPlanetary Wayback: Peer-To-Peer Permanence of Web Archives

Sawood Alam

Web Archive Profiling Through Fulltext Search

Sawood Alam

JCDL 2016 Doctoral Consortium - Web Archive Profiling

Sawood Alam

Web Archiving: A Brief Introduction

Sawood Alam

TPDL 2015 - Profiling Web Archives

Sawood Alam

Mais de Sawood Alam (20)

Profiling Web Archival Voids for Memento Routing

Readying Web Archives to Consume and Leverage Web Bundles

Summarize Your Archival Holdings With MementoMap

MementoMap: A Web Archive Profiling Framework for Efficient Memento Routing

Supporting Web Archiving via Web Packaging

MementoMap: An Archive Profile Dissemination Framework

Impact of HTTP Cookie Violations in Web Archives

Archive Assisted Archival Fixity Verification Framework

MementoMap Framework for Flexible and Adaptive Web Archive Profiling

Web ARChive (WARC) File Format

InterPlanetary Wayback: The Next Step Towards Decentralized Web Archiving

Avoiding Zombies in Archival Replay Using ServiceWorker

Client-side Reconstruction of Composite Mementos Using ServiceWorker

TPDL 2016 Doctoral Consortium - Web Archive Profiling

Introducing Web Archiving and WSDL Research Group

InterPlanetary Wayback: Peer-To-Peer Permanence of Web Archives

Web Archive Profiling Through Fulltext Search

JCDL 2016 Doctoral Consortium - Web Archive Profiling

Web Archiving: A Brief Introduction

TPDL 2015 - Profiling Web Archives

Último

Software Quality Assurance Interview Questions

Arshad QA

Pharm-D Biostatistics and Research methodology

Anusha Are

In an era where security concerns are paramount, the integration of artificial intelligence (AI) into CCTV cameras has revolutionized surveillance capabilities. One of the most significant advancements is the ability to achieve real-time threat detection, enabling immediate responses to potential security breaches. This blog explores how AI is reshaping surveillance through real-time threat detection and the implications of this technology.

Optimizing AI for immediate response in Smart CCTV

shikhaohhpro

%in Midrand+277-882-255-28 abortion pills for sale in midrand

masabamasaba

Test automation is a cornerstone of software development and quality assurance in today's rapidly evolving digital landscape. Its significance cannot be overstated. Businesses can enhance efficiency, productivity, and accelerate software delivery to market through automation, streamlining testing processes effectively. This comprehensive guide addresses the best practices for test automation in 2024. It offers a detailed checklist to empower you to optimize your automation efforts and maintain a competitive edge.

The Ultimate Test Automation Guide_ Best Practices and Tips.pdf

kalichargn70th171

In the realm of real-time applications, Large Language Models (LLMs) have long dominated language-centric tasks, while tools like OpenCV have excelled in the visual domain. However, the future (maybe) lies in the fusion of LLMs and deep learning, giving birth to the revolutionary concept of Large Action Models (LAMs). Imagine a world where AI not only comprehends language but mimics human actions on technology interfaces. For example, the Rabbit r1 device presented at CES 2024, driven by an AI operating system and LAM, brings this vision to life. It executes complex commands, leveraging GUIs with unprecedented ease. In this presentation, join me on a journey as a software engineer tinkering with WebRTC, Janus, and LLM/LAMs. Together, we’ll evaluate the current state of these AI technologies, unraveling the potential they hold for shaping the future of real-time applications.

Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications

Alberto González Trastoy

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf

kalichargn70th171

In today's dynamic e-commerce landscape, the payment gateway emerges as a linchpin, ensuring smooth and secure transactions between buyers and sellers. In this discourse, we delve into the meticulous process of devising test cases tailored for scrutinizing payment gateways. Crafting precise test cases for payment gateways is a quintessential responsibility for testers operating within the service industry. This article meticulously explores pivotal scenarios integral to how to test payment gateways, coupled with essential guidelines for drafting effective test cases.

Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf

kalichargn70th171

At the recent Microsoft Ignite 2023 conference, Microsoft unveiled a groundbreaking strategy that will redefine enterprise work management. The plan involves integrating Microsoft’s key planning tools, Microsoft To Do, Microsoft Planner, and Microsoft Project for the web into a unified experience called “Microsoft Planner.” What does this new strategy from Microsoft mean for current users? Join us and learn how best to take advantage of this announcement while gaining a clear path on how to elevate the current state of Microsoft Planner from a basic task manager to a comprehensive tool for Enterprise Work Management using OnePlan. Learn how OnePlan’s integration with Microsoft Planner allows for strategic alignment with business goals through advanced features like strategic planning, portfolio management, resource management, financial management, and more!

Introducing Microsoft’s new Enterprise Work Management (EWM) Solution

OnePlan Solutions

%in ivory park+277-882-255-28 abortion pills for sale in ivory park

masabamasaba

MakeMyPass" Online Bus Pass Management System illustrates the flow of activities and actions that occur within the system to accomplish specific tasks or use cases. This type of diagram focuses on representing the sequence of activities and decision points involved in a particular process. Below is an example outline and description of key elements that could be included in an Activity Diagram for the system:

BUS PASS MANGEMENT SYSTEM USING PHP.pptx

alwaysnagaraju26

InShot proinshot.com stands tall among its peers as the ultimate video editing app, offering simplicity, versatility, and power in one package. With its intuitive interface and comprehensive feature set, InShot caters to both beginners and seasoned editors alike. Whether you're creating content for social media, YouTube, or personal projects, InShot empowers you to unleash your creativity and transform your videos into captivating masterpieces. Join the millions of users who trust InShot https://www.proinshot.com/ for all their video editing needs and discover the difference for yourself!

Exploring the Best Video Editing App.pdf

proinshot.com

A Secure and Reliable Document Management System is Essential.docx

ComplianceQuest1

Investing in AI transformation today The modern business advantage: Uncovering deep insights with AI Organizations around the world have come to recognize AI as the transformative technology that enables them to gain real business advantage. AI’s ability to organize vast quantities of data allows those who implement it to uncover deep business insights, augment human expertise, drive operational efficiency, transform their products, and better serve their customers

Microsoft AI Transformation Partner Playbook.pdf

Willy Marroquin (WillyDevNET)

%in tembisa+277-882-255-28 abortion pills for sale in tembisa

masabamasaba

At TECUNIQUE, we're a stable and steadily growing Indian software services company with over 14 years of industry experience. Specializing in offshore software development and quality assurance services, we've built a reputation for delivering unique and effective solutions to start-ups, software development companies, enterprises, and digital agencies. We pride ourselves on our commitment to excellence and innovation. By blending insightful business domain knowledge with exceptional technical prowess, we craft tailor-made solutions that meet the unique needs of our clients. Our dedicated teams are adept in specific technologies, ensuring seamless integration of skills and delivering reliable, scalable, and high-quality software solutions aligned with our clients' preferences. Bespoke Dedicated Teams: Crafted to meet your specific needs and technology preferences, our dedicated teams are committed to delivering top-notch software solutions. Offshore Software Development: Accelerate your software development and scale up quickly with our 12+ years of expertise in offshore development. Quality Assurance Services: Ensure the quality of your software products with our dedicated teams of experienced QA professionals. IT Staff Augmentation: Overcome skill gaps with our client-centric software team, offering staff augmentation services. Expert Software Services: Unlock our capabilities in custom software development, product development, and quality assurance. Mission and Vision: Our mission at TECUNIQUE is to be the catalyst for our clients' success in the dynamic domain of software development. Rooted in our core values of respect, authenticity, and responsibility, we strive to ease the software outsourcing experience, reducing both time and cost to market for our clients. We envision ourselves as the leading Indian software services company, renowned for our unwavering commitment to excellence and innovation. www.tecunique.com

TECUNIQUE: Success Stories: IT Service provider

mohitmore19

MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...

Jittipong Loespradit

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

Looking for an efficient way to manage your finances? Look no further than our money management app. With easy-to-use features, you can track your expenses, create budgets, and monitor your savings goals all in one place. Our app provides real-time updates on your spending habits and helps you make smarter financial decisions. Take control of your finances today with our user-friendly money management app.

Right Money Management App For Your Financial Goals

Jhone kinadey

Many specialized tools cater to distinct stages within the software development lifecycle (SDLC). These tools target various aspects of development, delivery, and operations, each with its unique strengths. Uniting these diverse testing needs into a single continuous testing platform presents several challenges. Such a platform must seamlessly integrate with various development tools and environments, accommodate different testing methodologies, and remain flexible to adapt to organizational processes and quality standards.

The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...

kalichargn70th171