State of NuPIC

•Transferir como PPTX, PDF•

1 gostou•3,224 visualizações

Matt talks about how far we've come as an open source project in the past year, the current state of NuPIC, and plans for the future.

Software Tecnologia

The State of NuPIC
where we’ve been
where we are
where we’re going

Open Source Event: June 3, 2013
• 88,911 lines of code
pushed to Github
– no issue tracking
– no continuous integration
– no public unit tests
– no swarming
– Python 2.6 only
– gcc only

First Hackathon: June 21
• 24-hour event held in
Numenta office
• 15 – 20 solid participants
• 8 demos
• Build problems galore!

Second Hackathon: Nov 2013
• 55 attendees in San Francisco
• 5 talks, 7 demos
• Lots of buzz
• Still build problems! 

Focus on Community Goals
• January community poll about most important
work to be done within NuPIC
• TRANSPORTABILITY
– C++ / Python split
• USABILITY
– Code samples, tutorials, better documentation,
automated API docs, easier build / installation
• HIERARCHY
– Temporal pooling, hierarchy API

NuPIC Core Extraction Plan
(Transportability)

Build Improvements (Usability)
• Cmake build
• Better compiler support (clang & gcc)
• Python 2.7 support (finally!)
• Simpler build process
– Less environment changes
– Less instructions
• Docker support

Samples & Tutorials (Usability)
• Sine Wave Tutorial
Screencast
• Swarm Examples
Codebase
• Hot Gym Tutorial
Screencast
• Audio Stream Example
• Spatial Pooler Example
• NuPIC Development
Tutorial Screencast

Documentation Updates (Usability)
API Docs Wiki Facelift

C++ / Python Split is Complete
but the job ain’t done yet
• github.com/numenta/nupic
• github.com/numenta/nupic.core
• nupic.core builds autonomously
– has its own CI
– still needs:
• API tests
• complete automated API docs
• C++ test suite with reporting
• C++ Algorithms are incomplete
– sequence memory still in python
• Release V1.0

93 Contributors
• 28 have pushed code
• 10 or so consistently
active
• 11 committers
– 3 promoted from
community so far

Moving towards Hierarchy
• Jeff released new ideas about true temporal
pooling on our mailing list
• Recent talks at Meetups and conferences
about these ideas
• He and Subutai will
be making time this
year to work on
implementations
within NuPIC

The Dream
• Easily configured hierarchy of CLA regions
• Distributed networks of hierarchies
– each region could be implemented in a different
client language
– standardized communication protocol
• Global standard for fast model serialization
– allowing model states transportability
• Hosted swarming service
• Hardware implementations of CLA / HTM

Mais conteúdo relacionado

Mais procurados

Divide and Conquer

Dr Shashikant Athawale

Agile code quality metrics

Gil Nahmias

Attention Is All You Need. With these simple words, the Deep Learning industry was forever changed. Transformers were initially introduced in the field of Natural Language Processing to enhance language translation, but they demonstrated astonishing results even outside language processing. In particular, they recently spread in the Computer Vision community, advancing the state-of-the-art on many vision tasks. But what are Transformers? What is the mechanism of self-attention, and do we really need it? How did they revolutionize Computer Vision? Will they ever replace convolutional neural networks? These and many other questions will be answered during the talk. In this tech talk, we will discuss: - A piece of history: Why did we need a new architecture? - What is self-attention, and where does this concept come from? - The Transformer architecture and its mechanisms - Vision Transformers: An Image is worth 16x16 words - Video Understanding using Transformers: the space + time approach - The scale and data problem: Is Attention what we really need? - The future of Computer Vision through Transformers Speaker: Davide Coccomini, Nicola Messina Website: https://www.aicamp.ai/event/eventdetails/W2021101110

Transformers in Vision: From Zero to Hero

Bill Liu

Genetic Algorithms - Artificial Intelligence

Sahil Kumar

Non- Deterministic Algorithms

Dipankar Boruah

This seminar was presented by Ashish Kumar A randomized algorithm is defined as an algorithm that typically uses the random bits as an auxiliary input to guide its behavior. It achievs good performance in the "average case". Formally, the algorithm's performance will be a random variable determined by the random bits, with (hopefully) good expected value. The "worst case" is typically so unlikely to occur that it can be ignored. First and foremost reason for using randomized algorithms is simplicity.

Randomized Algorithm

Sanjeev Kumar Jaiswal

04 Multi-layer Feedforward Networks

Tamer Ahmed Farrag, PhD

Multi-Layer Perceptrons

ESCOM

007 20151214 Deep Unsupervised Learning using Nonequlibrium Thermodynamics

Ha Phuong

Compiler: Syntax Analysis

Dr. Jaydeep Patil

Introduction to artificial neural network

Dr. C.V. Suresh Babu

Fuzzy inference systems

Siksha 'O' Anusandhan (Deemed to be University )

Chap 9 reliability

Phuoc Hung Nguyen

A* Algorithm

Dr. C.V. Suresh Babu

Slides of the keynote speech on "Constraints for process framing in Augmented BPM" at the AI4BPM 2022 International Workshop, co-located with BPM 2022. The keynote focuses on the problem of "process framing" in the context of the new vision of "Augmented BPM", where BPM systems are augmented with AI capabilities. This vision is described in a manifesto, available here: https://arxiv.org/abs/2201.12855

Constraints for Process Framing in Augmented BPM

Faculty of Computer Science - Free University of Bozen-Bolzano

Attention in Deep Learning

健程杨

B.sc CSIT 2nd semester C++ Unit4

Tekendra Nath Yogi

Statement of stochastic programming problems

SSA KPI

9. chapter 8 np hard and np complete problems

Jyotsna Suryadevara

R-CNN

Mohamed Rashid

Mais procurados (20)

Divide and Conquer

Agile code quality metrics

Transformers in Vision: From Zero to Hero

Genetic Algorithms - Artificial Intelligence

Non- Deterministic Algorithms

Randomized Algorithm

04 Multi-layer Feedforward Networks

Multi-Layer Perceptrons

007 20151214 Deep Unsupervised Learning using Nonequlibrium Thermodynamics

Compiler: Syntax Analysis

Introduction to artificial neural network

Fuzzy inference systems

Chap 9 reliability

A* Algorithm

Constraints for Process Framing in Augmented BPM

Attention in Deep Learning

B.sc CSIT 2nd semester C++ Unit4

Statement of stochastic programming problems

9. chapter 8 np hard and np complete problems

R-CNN

Destaque

Beginner's Guide to NuPIC

Numenta

Getting Started with Numenta Technology

Numenta

Temporal memory in racket

Numenta

Applications of Hierarchical Temporal Memory (HTM)

Numenta

Anomaly Detection Using the CLA

Numenta

Predictive Analytics with Numenta Machine Intelligence

Numenta

Principles of Hierarchical Temporal Memory - Foundations of Machine Intelligence

Numenta

Brains, Data, and Machine Intelligence (2014 04 14 London Meetup)

Numenta

2014 Fall NuPIC Hackathon Kickoff

Numenta

Sparse Distributed Representations: Our Brain's Data Structure

Numenta

Evaluating Real-Time Anomaly Detection: The Numenta Anomaly Benchmark

Numenta

Detecting Anomalies in Streaming Data

Numenta

2014 Spring NuPIC Hackathon Kickoff

Numenta

A Whole New World [DEMO #4] (2014 Fall NuPIC Hackathon)

Numenta

We'll Always Have Paris

Numenta

Why Neurons have thousands of synapses? A model of sequence memory in the brain

Numenta

What the Brain says about Machine Intelligence

Numenta

Real-Time Streaming Data Analysis with HTM

Numenta

Science of Anomaly Detection

Numenta

HTM Theory

Asfak Mahamud

Destaque (20)

Beginner's Guide to NuPIC

Getting Started with Numenta Technology

Temporal memory in racket

Applications of Hierarchical Temporal Memory (HTM)

Anomaly Detection Using the CLA

Predictive Analytics with Numenta Machine Intelligence

Principles of Hierarchical Temporal Memory - Foundations of Machine Intelligence

Brains, Data, and Machine Intelligence (2014 04 14 London Meetup)

2014 Fall NuPIC Hackathon Kickoff

Sparse Distributed Representations: Our Brain's Data Structure

Evaluating Real-Time Anomaly Detection: The Numenta Anomaly Benchmark

Detecting Anomalies in Streaming Data

2014 Spring NuPIC Hackathon Kickoff

A Whole New World [DEMO #4] (2014 Fall NuPIC Hackathon)

We'll Always Have Paris

Why Neurons have thousands of synapses? A model of sequence memory in the brain

What the Brain says about Machine Intelligence

Real-Time Streaming Data Analysis with HTM

Science of Anomaly Detection

HTM Theory

Semelhante a State of NuPIC

PyWPS-4.0.0

Jachym Cepicky

Pywps

Luis_de_Sousa

Codifying the Build and Release Process with a Jenkins Pipeline Shared Library

Alvin Huang

Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.

Netflix Open Source: Building a Distributed and Automated Open Source Program

aspyker

Building a Distributed & Automated Open Source Program at Netflix

All Things Open

OpenStack Documentation in the Open

Anne Gentle

In 2019 the HCL Labs reimagined how a REST API for Domino should look like. The initial prototype was shared with selected customers and partner. Based on the feedback, Project KEEP will ship together with Domino. KEEP allows applications to interact with Domino servers using simple HTTP calls directly from a browser, desktop or mobile app, or with a application server in the middle. To make this API accessible to a large audience open standards like OpenAPI or JWT were chosen over propriety implementations. This session will introduce KEEP and the design principles and use cases. Data security and ease of use will be highlighted. Warm up your Postman clients and curl command lines and follow along! The presenters for this session will be Stephan Wissel and Paul Withers from HCL.

July OpenNTF Webinar - HCL Presents Keep, a new API for Domino

Howard Greenberg

Portable infrastructure with puppet

lkanies

Create great cncf user base from lessons learned from other open source com...

Krishna-Kumar

Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015

Chris Jang

Next generation pipelines

Alex Landa

DockerCon 15 Keynote - Day 2

Docker, Inc.

A commonly used version control system in the ColdFusion community is Subversion -- a centralized system that relies on being connected to a central server. The next generation version control systems are “decentralized”, in that version control tasks do not rely on a central server. Decentralized version control systems are more efficient and offer a more practical way of software development. In this session, Indy takes you through the considerations in moving from Subversion to Git, a decentralized version control system. You also get to understand the pros and cons of each and hear of the practical experience of migrating projects to decentralized version control. Version control is often used in conjunction with a testing framework and continuous integration. To complete the picture, Indy walks you through how to integrate Git with a testing framework, MXUnit, and a continuous integration server, Hudson.

Make It Cooler: Using Decentralized Version Control

indiver

Building OPNFV as a Platform

OPNFV

Open MPI SC'15 State of the Union BOF

Jeff Squyres

Fast and efficient software testing is easy with Docker. We often use containers to maintain parity across development, testing, and production environments, but we can also use containerization to significantly reduce time needed for testing by spinning up multiple instances of fully isolated testing environments and executing tests in parallel. This strategy also helps you maximize the utilization of infrastructure resources. The enhanced toolset provided by Docker makes this process simple and unobtrusive, and you’ll see how Docker Engine, Registry, Machine, and Compose can work together to make your tests fast.

Efficient Parallel Testing with Docker by Laura Frank

Docker, Inc.

Kubecon seattle 2018 recap - Application Deployment aspects

Krishna-Kumar

Continuous delivery with open source tools

Sebastian Helzle

Topics of this presentation: - Basics and best practices of developing single-page applications (SPA) and Web API Services on Microsoft .NET - - Core with Docker and Linux. - PowerShell Core automated builds. - Markdown/PDF documentation. - Documentation of public interfaces with Swagger/OAS/YAML. - Automated testing of SPA on Protractor and testing the Web API on Postman/Newman. This presentation by Sergii Fradkov (Consultant, Engineering), Andrii Zarharov (Lead Software Engineer, Consultant), Igor Magdich (Lead Test Engineer, Consultant) was delivered at GlobalLogic Kharkiv .NET TechTalk #1 on May 24, 2019.

Modern Web-site Development Pipeline

GlobalLogic Ukraine

Agnostic Continuous Delivery

Hervé Leclerc

Semelhante a State of NuPIC (20)

PyWPS-4.0.0

Pywps

Codifying the Build and Release Process with a Jenkins Pipeline Shared Library

Netflix Open Source: Building a Distributed and Automated Open Source Program

Building a Distributed & Automated Open Source Program at Netflix

OpenStack Documentation in the Open

July OpenNTF Webinar - HCL Presents Keep, a new API for Domino

Portable infrastructure with puppet

Create great cncf user base from lessons learned from other open source com...

Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015

Next generation pipelines

DockerCon 15 Keynote - Day 2

Make It Cooler: Using Decentralized Version Control

Building OPNFV as a Platform

Open MPI SC'15 State of the Union BOF

Efficient Parallel Testing with Docker by Laura Frank

Kubecon seattle 2018 recap - Application Deployment aspects

Continuous delivery with open source tools

Modern Web-site Development Pipeline

Agnostic Continuous Delivery

Mais de Numenta

Deep learning at the edge: 100x Inference improvement on edge devices

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ Neuromodulators are signalling chemicals in the brain, which control the emergence of adaptive learning and behaviour. Neuromodulators including dopamine, acetylcholine, serotonin and noradrenaline operate on a spectrum of spatio-temporal scales in tandem and opposition to reconfigure functions of biological neural networks and to regulate global cognition and state transition. Although neuromodulators are important in shaping cognition, their phenomenology is yet to be fully realized in deep neural networks (DNNs). In this talk, we will give an overview of the biological organizing principles of neuromodulators in adaptive cognition and highlight the competition and cooperation across neuromodulators.

Brains@Bay Meetup: A Primer on Neuromodulatory Systems - Srikanth Ramaswamy

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ A hallmark of intelligence is the ability to learn new flexible, cognitive behaviors - that is, behaviors that require discovering, storing and exploiting novel information for each new instance of the task. In meta-learning, agents are trained with external algorithms to learn one specific cognitive task. However, animals are able to pick up such cognitive tasks automatically, as a result of their evolved neural architecture and synaptic plasticity mechanisms, including neuromodulation. Here we evolve neural networks, endowed with plastic connections and reward-based neuromodulation, over a sizable set of simple meta-learning tasks based on a framework from computational neuroscience. The resulting evolved networks can automatically acquire a novel simple cognitive task, never seen during evolution, through the spontaneous operation of their evolved neural organization and plasticity system. We suggest that attending to the multiplicity of loops involved in natural learning may provide useful insight into the emergence of intelligent behavior.

Brains@Bay Meetup: How to Evolve Your Own Lab Rat - Thomas Miconi

Numenta

We receive information about the world through our sensors and influence the world through our effectors. Such low-level data has gradually come to play a greater role in AI during its 70-year history. I see this as occurring in four steps, two of which are mostly past and two of which are in progress or yet to come. The first step was to view AI as the design of agents which interact with the world and thereby have sensorimotor experience; this viewpoint became prominent in the 1980s and 1990s. The second step was to view the goal of intelligence in terms of experience, as in the reward signal of optimal control and reinforcement learning. The reward formulation of goals is now widely used but rarely loved. Many would prefer to express goals in non-experiential terms, such as reaching a destination or benefiting humanity, but settle for reward because, as an experiential signal, reward is directly available to the agent without human assistance or interpretation. This is the pattern that we see in all four steps. Initially a non-experiential approach seems more intuitive, is preferred and tried, but ultimately proves a limitation on scaling; the experiential approach is more suited to learning and scaling with computational resources. The third step in the increasing role of experience in AI concerns the agent’s representation of the world’s state. Classically, the state of the world is represented in objective terms external to the agent, such as “the grass is wet” and “the car is ten meters in front of me”, or with probability distributions over world states such as in POMDPs and other Bayesian approaches. Alternatively, the state of the world can be represented experientially in terms of summaries of past experience (e.g., the last four Atari video frames input to DQN) or predictions of future experience (e.g., successor representations). The fourth step is potentially the biggest: world knowledge. Classically, world knowledge has always been expressed in terms far from experience, and this has limited its ability to be learned and maintained. Today we are seeing more calls for knowledge to be predictive and grounded in experience. After reviewing the history and prospects of the four steps, I propose a minimal architecture for an intelligent agent that is entirely grounded in experience.

Brains@Bay Meetup: The Increasing Role of Sensorimotor Experience in Artifici...

Numenta

In this talk, I will propose a conceptual framework sketching a path toward open-ended skill acquisition through the coupling of environmental, morphological, sensorimotor, cognitive, developmental, social, cultural and evolutionary mechanisms. I will illustrate parts of this framework through computational experiments highlighting the key role of intrinsically motivated exploration in the generation of behavioral regularity and diversity. Firstly, I will show how some forms of language can self-organize out of generic exploration mechanisms without any functional pressure to communicate. Secondly, we will see how language — once invented — can be recruited as a cognitive tool that enables compositional imagination and bootstraps open-ended cultural innovation. For more:

Brains@Bay Meetup: Open-ended Skill Acquisition in Humans and Machines: An Ev...

Numenta

Most current deep neural networks learn from a static data set without active interaction with the world. We take a look at how learning through a closed loop between action and perception affects the representations learned in a DNN. We demonstrate how these representations are significantly different from DNNs that learn supervised or unsupervised from a static dataset without interaction. These representations are much sparser and encode meaningful content in an efficient way. Even an agent who learned without any external supervision, purely through curious interaction with the world, acquires encodings of the high dimensional visual input that enable the agent to recognize objects using only a handful of labeled examples. Our results highlight the capabilities that emerge from letting DNNs learn more similar to biological brains, though sensorimotor interaction with the world. For more:

Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...

Numenta

SBMT 2021: Can Neuroscience Insights Transform AI? - Lawrence Spracklen

Numenta

Nick Ni (Xilinx) and Lawrence Spracklen (Numenta) presented a talk at the FGPA Conference Europe on July 8th, 2021. In this talk, they presented a neuroscience approach to optimize state-of-the-art deep learning networks into sparse topology and how it can unlock significant performance gains on FPGAs without major loss of accuracy. They then walked through the FPGA implementation where they exploited the advantage of sparse networks with a unique Domain Specific Architecture (DSA).

FPGA Conference 2021: Breaking the TOPS ceiling with sparse neural networks -...

Numenta

BAAI Conference 2021: The Thousand Brains Theory - A Roadmap for Creating Mac...

Numenta

Jeff Hawkins presents a talk on "How the Brain Uses Reference Frames to Model the World, Why AI Needs to do the Same." In this talk, he gives an overview of The Thousand Brains Theory and discusses how machine intelligence can benefit from working on the same principles as the neocortex. This talk was first presented at the NAISys conference on November 10, 2020. You can find a re-recording of the talk here: https://youtu.be/mGSG7I9VKDU

Jeff Hawkins NAISys 2020: How the Brain Uses Reference Frames, Why AI Needs t...

Numenta

In this research meeting, guest Stephen Omohundro gave a fascinating talk on GPT-3, the new massive OpenAI Natural Language Processing model. He reviewed the network architecture, training process, and results in the context of past work. There was extensive discussion on the implications for NLP and for Machine Intelligence / AGI. Link to GPT-3 paper: https://arxiv.org/abs/2005.14165 Link to YouTube recording of Steve's talk: https://youtu.be/0ZVOmBp29E0

OpenAI’s GPT 3 Language Model - guest Steve Omohundro

Numenta

CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...

Numenta

Sparsity In The Neocortex, And Its Implications For Machine Learning

Numenta

Recent advances in reverse engineering the neocortex reveal that it is a highly-distributed sensory-motor modeling system. Each cortical column learns complete models of observed objects through movement and sensation. The columns use long-range connections to vote on what objects are currently being observed. In this talk, we introduce the key elements of this theory and describe how these elements can be introduced into current machine learning techniques to improve their capabilities, robustness, and power requirements.

The Thousand Brains Theory: A Framework for Understanding the Neocortex and B...

Numenta

Jeff Hawkins Human Brain Project Summit Keynote: "Location, Location, Locatio...

Numenta

Location, Location, Location - A Framework for Intelligence and Cortical Comp...

Numenta

Have We Missed Half of What the Neocortex Does? A New Predictive Framework ...

Numenta

Locations in the Neocortex: A Theory of Sensorimotor Prediction Using Cortica...

Numenta

The Predictive Neuron: How Active Dendrites Enable Spatiotemporal Computation...

Numenta

These are Matt Taylor's slides from the AI Singapore Meetup on May 17, 2018. Abstract: Today’s wave of AI technology is still being driven by the ANN neuron pioneered decades ago. Hierarchical Temporal Memory (HTM) is a realistic biologically-constrained model of the pyramidal neuron reflecting today’s most recent neocortical research. This talk will describe and visualize core HTM concepts like sparse distributed representations, spatial pooling and temporal memory. Strong AI is a common goal of many computer scientists. So far, machine learning techniques have created amazing results in narrow fields, but haven’t produced something we could all call “intelligent”. Given recent advances in neuroscience research, we know a lot more about how neurons work together now than we did when ANNs were created. We believe systems with a more realistic neuronal model will be more likely to produce Strong AI. Hierarchical Temporal Memory is a theory of intelligence based upon neuroscience research. The neocortex is the seat of intelligence in the brain, and it is structurally homogeneous throughout. This means a common algorithm is processing all your sensory input, no matter which sense. We believe we have discovered some of the foundational algorithms of the neocortex, and we’ve implemented them in software. I’ll show you how they work with detailed dynamic visualizations of Sparse Distributed Representations, Spatial Pooling, and Temporal Memory.

The Biological Path Toward Strong AI by Matt Taylor (05/17/18)

Numenta

Mais de Numenta (20)