Overcoming common knowledge: 100k nodes in a single folder

•

2 gostaram•403 visualizações

Alfresco Best Practices tell us "Don't store more than 2000 nodes in a single folder". But in many use cases having thousands of nodes on one logical level is natural. Let's see why best practices tell us so, how to overcome it, limitations and benefits of the implementation.

Tecnologia

Overcoming common
knowledge: 100k nodes
in a single folder
Oksana Kurysheva

Oksana Kurysheva
Project Manager at ITD Systems
Queen of the Bees at Order of the Bee
My cat writes JavaScript for Aikau

Learn. Connect. Collaborate.
Agenda
100k nodes in a single folder
• Business use cases
• Problem statement
• Possible solutions
• Demo

Learn. Connect. Collaborate.
Use Case #1. Collaborative Content

Learn. Connect. Collaborate.
Use Case #2. Transactional Content

Learn. Connect. Collaborate.
Problem Statement. Alfresco Best Practices
Luis Cabaceira
Solution Architect, Alfresco
Slide from BeeCon 2017

Learn. Connect. Collaborate.
Problem Statement. The reason

Learn. Connect. Collaborate.
Do we really need to hide the fact of document
existence from users?
• Alice thinks that there are 30 documents
• Mike thinks that there are 50 documents
• Administrator knows that there are 60 documents

Learn. Connect. Collaborate.
Do we really need to hide the fact of document
existence from users?
• Invoice #1
• Invoice #3
• Where is invoice #2? Can I create Invoice #4 or does it exist?

Learn. Connect. Collaborate.
Our approach
1. Do not hide existence of the node from the user

Learn. Connect. Collaborate.
Our approach
1. Do not hide existence of the node from the user
2. Apply search and sort at DB level, make them really fast

Learn. Connect. Collaborate.
Our approach
1. Do not hide existence of the node from the user
2. Apply search and sort at DB level, make them really fast
3. Load single page of data into RAM

Learn. Connect. Collaborate.
Field-level security

Learn. Connect. Collaborate.
Hidden issues
• Search by sensitive data

Learn. Connect. Collaborate.
Hidden issues

Questions?
Thank you!
ok@itdhq.com
https://github.com/ITDSystems/alvex-registers

Mais conteúdo relacionado

Semelhante a Overcoming common knowledge: 100k nodes in a single folder

Harvesting The Web With Cloud Computing

King Huang

In 1971, David Parnas wrote the great paper, "On the criteria to be used decomposing the system into parts," and yet the problem of breaking down big projects into small parts that work well together remains a struggle in the industry. The ability to decompose a problem space and in turn, compose a solution is essential to our work. Things have gotten worse since 1971. With microservices, big data, and streaming systems, we're all going to be distributed systems engineers sooner or later. In distributed systems, effective decomposition has an even greater impact on the reliability, performance, and availability of our systems as it determines the frequency and weight of communication in the system. This talk speaks to the essential considerations for defining and evaluating boundaries and behaviors in large-scale distributed systems. It will touch on topics such as bulkhead design and architectural evolution.

Large Components in the Rearview Mirror

Michelle Brush

Preservation and institutional repositories for the digital arts and humanities

Dorothea Salo

Finding harmony in web development

Christian Heilmann

Doctrine2

escorpion2610

Doctrine2 enterpice

escorpion2610

Doctrine 2 - Enterprise Persistence Layer For PHP

Jonathan Wage

Zalando strives to be a fully data-driven company that utilizes AI to make decisions fast and accurately. For this reason we have built a Data Lake that contains all data of the company. To provide easy access to that data and enable the company to make use of it, we have established an internal platform that offers Databricks as a service for all departments and teams. Making Databricks Delta tables available to all clients of the Data Lake enabled them to leverage Structured Streaming and to build continuous applications on top of it. Big part of this journey was solving challenges in governance, security and access management. In this talk we want to share our experience in productionizing and operating Databricks at scale and in making data-driven continuous applications feasible out of the box.

Continuous Applications at Scale of 100 Teams with Databricks Delta and Struc...

Databricks

Doctrine 2 - Not The Same Old Php Orm

Jonathan Wage

Data can be viewed as the exhaust of online activity. With the rise of cloud-based data platforms, barriers to data storage and transfer have crumbled. The demand for creative applications and learning from those datasets has accelerated. Rapid acceleration can quickly accrue disorder, and disorderly data design can turn the deepest data lake into an impenetrable swamp. In this talk, I will discuss the evolution of the data science workflow at Expedia with a special emphasis on Learning to Rank problems. From the heroic early days of ad-hoc Spark exploration to our first production sort model on the cloud, we will explore the process of industrializing the workflow. Layered over our story, I will share some best practices and suggestions on how to keep your data productive, or even pull your organization out of the data swamp.

Rental Cars and Industrialized Learning to Rank with Sean Downes

Databricks

Introduction To Doctrine 2

Jonathan Wage

10 Real Life Network Documentation Hacks & How to Do it Right

Graphical Networks

Presentation for Harvard's ABCD Technology in Education group: The Institute for Quantitative Social Science (IQSS) is a unique entity at Harvard - it combines research, software development, and specialized services to provide innovative solutions to research and scholarship problems at Harvard and beyond. I will talk about the software projects that IQSS is currently working on (Dataverse, Zelig, Consilience, and OpenScholar), including the research and development processes, the benefits provided to the Harvard community, and the impacts on research and scholarship.

Abcd iqs ssoftware-projects-mercecrosas

Merce Crosas

Building reusable components with generics and protocols

Donny Wals

Many Hats at Cloudera

Alex Moundalexis

Talk @FH Hagenberg - Data viz in a collaborative mixed reality space

Stefan Wasserbauer

MDN Development & Web Documentation

Jay Patel

Navigating the Mess of a Shared drive Migration to SharePoint

Joanne Klein

Eurodidaweb2012 03-13

Stefano Lariccia

Understanding Research 2.0 from a Socio-technical Perspective

Yuwei Lin

Semelhante a Overcoming common knowledge: 100k nodes in a single folder (20)

Harvesting The Web With Cloud Computing

Large Components in the Rearview Mirror

Preservation and institutional repositories for the digital arts and humanities

Finding harmony in web development

Doctrine2

Doctrine2 enterpice

Doctrine 2 - Enterprise Persistence Layer For PHP

Continuous Applications at Scale of 100 Teams with Databricks Delta and Struc...

Doctrine 2 - Not The Same Old Php Orm

Rental Cars and Industrialized Learning to Rank with Sean Downes

Introduction To Doctrine 2

10 Real Life Network Documentation Hacks & How to Do it Right

Abcd iqs ssoftware-projects-mercecrosas

Building reusable components with generics and protocols

Many Hats at Cloudera

Talk @FH Hagenberg - Data viz in a collaborative mixed reality space

MDN Development & Web Documentation

Navigating the Mess of a Shared drive Migration to SharePoint

Eurodidaweb2012 03-13

Understanding Research 2.0 from a Socio-technical Perspective

Mais de ITD Systems

Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objects

ITD Systems

Data Spider for Legacy Infrastructure: Capturing content from multiple file s...

ITD Systems

External Master Data in Alfresco: Integrating and Keeping Metadata Consistent...

ITD Systems

Примечания к демо

ITD Systems

Special Notes for the Alvex Demo

ITD Systems

Testing Alfresco extensions

ITD Systems

Project Management with Alfresco

ITD Systems

PM Innovation 2013 - Управление непредсказуемым проектом

ITD Systems

Alvex. Become a partner

ITD Systems

Краткий обзор возможностей Alfresco и Alvex

ITD Systems

Orgchart for Alfresco lightning talk

ITD Systems

Dynamic bpm design by doing lightning talk

ITD Systems

Mais de ITD Systems (12)

Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objects

Data Spider for Legacy Infrastructure: Capturing content from multiple file s...

External Master Data in Alfresco: Integrating and Keeping Metadata Consistent...

Примечания к демо

Special Notes for the Alvex Demo

Testing Alfresco extensions

Project Management with Alfresco

PM Innovation 2013 - Управление непредсказуемым проектом

Alvex. Become a partner

Краткий обзор возможностей Alfresco и Alvex

Orgchart for Alfresco lightning talk

Dynamic bpm design by doing lightning talk

Último

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Architecting Cloud Native Applications

WSO2

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Modernizing Securities Finance: The cloud-native prime brokerage platform transforming capital markets. Madhu Subbu, Managing Director, Head of Securities Finance Engineering Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

apidays

ICT role in 21st century education and its challenges

rafiqahmad00786416

Scalable LLM APIs for AI and Generative AI Application Development Ettikan Karuppiah, Director/Technologist - NVIDIA Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

apidays

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Zilliz

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

MINDCTI Revenue Release Quarter One 2024

MIND CTI

AXA XL - Insurer Innovation Award Americas 2024

The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

Overcoming common knowledge: 100k nodes in a single folder

1. Overcoming common knowledge: 100k nodes in a single folder Oksana Kurysheva

2. Oksana Kurysheva Project Manager at ITD Systems Queen of the Bees at Order of the Bee My cat writes JavaScript for Aikau

3. Learn. Connect. Collaborate. Agenda 100k nodes in a single folder • Business use cases • Problem statement • Possible solutions • Demo

4. Use Cases

5. Learn. Connect. Collaborate. Use Case #1. Collaborative Content

6. Learn. Connect. Collaborate. Use Case #2. Transactional Content

7. Learn. Connect. Collaborate.

8. What is the problem?

9. Learn. Connect. Collaborate. Problem Statement. Alfresco Best Practices Luis Cabaceira Solution Architect, Alfresco Slide from BeeCon 2017

10. Learn. Connect. Collaborate.

11. Learn. Connect. Collaborate. Problem Statement. The reason

12. Learn. Connect. Collaborate. Do we really need to hide the fact of document existence from users? • Alice thinks that there are 30 documents • Mike thinks that there are 50 documents • Administrator knows that there are 60 documents

13. Learn. Connect. Collaborate. Do we really need to hide the fact of document existence from users? • Invoice #1 • Invoice #3 • Where is invoice #2? Can I create Invoice #4 or does it exist?

14. What can we do with it?

15. Learn. Connect. Collaborate. Our approach 1. Do not hide existence of the node from the user

16. Learn. Connect. Collaborate.

17. Learn. Connect. Collaborate. Our approach 1. Do not hide existence of the node from the user 2. Apply search and sort at DB level, make them really fast

18. Learn. Connect. Collaborate. Our approach 1. Do not hide existence of the node from the user 2. Apply search and sort at DB level, make them really fast 3. Load single page of data into RAM

19. Learn. Connect. Collaborate. Our approach 1. Do not hide existence of the node from the user 2. Apply search and sort at DB level, make them really fast 3. Load single page of data into RAM 4. Process this page with permissions, custom logic etc

20. Learn. Connect. Collaborate. Our approach 1. Do not hide existence of the node from the user 2. Apply search and sort at DB level, make them really fast 3. Load single page of data into RAM 4. Process this page with permissions, custom logic etc 5. Return the data to the browser

21. Learn. Connect. Collaborate. Field-level security

22. Learn. Connect. Collaborate. Hidden issues • Search by sensitive data

23. Learn. Connect. Collaborate. Hidden issues

24. Learn. Connect. Collaborate. Hidden issues

25. Live Demo

26. Questions? Thank you! ok@itdhq.com https://github.com/ITDSystems/alvex-registers