Towards an Optimizer for MLbase (Hướng tới một bộ tối ưu cho MLbase) - Ameet Talwalkar

UN
Uni24h
0 lượt tải
117
0

Đang tạo bản xem trước...

Tài liệu tiếp của tác giảMLlib and Distributing the Singular Value Decomposition - Reza ZadehCùng môn trướcDistributed Computing with Spark (Tính toán phân tán với Spark) - Reza ZadehCùng môn sauMLlib and Distributing the Singular Value Decomposition - Reza Zadeh

Nội dung tài liệu

Trang 1

Towards an OpBmizer for MLbase Ameet Talwalkar Collaborators: Evan Sparks, Michael Franklin, Michael I. Jordan, Tim Kraska UC Berkeley

Trang 3

Problem: Scalable implementa.ons Me difficult for ML Developers…ML Contract + Code The Language of Technical Computing ML MATLAB® is a high-level language and interactive environment for numerical com- Key Features putation, visualization, and programming. Using MATLAB, you can analyze data, t )JHIMFWFMMBOHVBHFGPSOVNFSJDBM t #VJMUJOHSBQIJDTGPSWJTVBMJ[JOHEBUB develop algorithms, and create models and DPNQVUBUJPO WJTVBMJ[BUJPO BOEBQ- BOEUPPMTGPSDSFBUJOHDVTUPNQMPUT applications. The language, tools, and built- QMJDBUJPOEFWFMPQNFOU t %FWFMPQNFOUUPPMTGPSJNQSPWJOH in math functions enable you to explore t *OUFSBDUJWFFOWJSPONFOUGPSJUFSBUJWF DPEFRVBMJUZBOENBJOUBJOBCJMJUZ multiple approaches and reach a solution FYQMPSBUJPO EFTJHO BOEQSPCMFN BOENBYJNJ[JOHQFSGPSNBODF faster than with spreadsheets or traditional TPMWJOH t 5PPMTGPSCVJMEJOHBQQMJDBUJPOTXJUI programming languages, such as C/C++ or t .BUIFNBUJDBMGVODUJPOTGPSMJOFBS DVTUPNHSBQIJDBMJOUFSGBDFT Java™.You can use MATLAB for a range of applications, including signal processing and - BMHFCSBGJMUFSJOHJOUFHSBUJPOPQUJNJ[BUJPOTUBUJTUJDTBOETPMWJOH'PVSJFSOVNFSJDBMPSEJOBSZBOBMZTJT  t 'VODUJPOTCBTFEQMJDBUJPOTBMHPSJUINTGPSBOEJOUFHSBUJOHMBOHVBHFTXJUIFYUFSOBM."5-"#TVDIBTBQ$-  S EJGGFSFOUJBMFRVBUJPOT communications, image and video process- +BWB /&5 BOE.JDSPTPGU®&YDFM® ing, control systems, test and measurement, computational finance, and computational biology. More than a million engineers and scientists in industry and academia use MATLAB, the language of technical computing. MATLAB Overview 2:04 Analyzing and visualizing data using the MATLAB desktop. The MATLAB environment also lets you write programs and develop algorithms and applications.

Trang 5

Problem: Scalable implementa.ons Me difficult for ML Developers…ML Contract + Code ML S CHALLENGE: Can we simplify distributed ML development?

Trang 9

Problem: ML is difficult for End Users… Too many Too many algorithms… knobs… Too many ways to preprocess…

Trang 10

Problem: ML is difficult for End Users… Too many Too many algorithms… knobs… Too many ways to preprocess… Difficult to debug…

Trang 11

Problem: ML is difficult for End Users… Too many Too many algorithms… knobs… Too many ways to preprocess… Difficult to debug… Doesn’t scale…

Trang 12

Problem: ML is difficult for End Users… Too many Too many algorithms… knobs… Too many ways to preprocess… Difficult to debug… CHALLENGE: Can we automate ML pipeline construcBonDoesn’t scale…?

Trang 14

MLbase MLbase aims to simplify development and deployment of ML pipelines Apache Spark Spark: Cluster compuBng system designed for iteraBve computaBon 4

Trang 15

MLbase MLbase aims to simplify development and deployment of ML MLlib pipelines Apache Spark Spark: Cluster compuBng system designed for iteraBve computaBon MLlib: Spark’s core ML library 4

Trang 16

MLbase MLbase aims to simplify development MLI and deployment of ML MLlib pipelines Apache Spark Spark: Cluster compuBng system designed for iteraBve computaBon MLlib: Spark’s core ML library MLI: API to simplify ML development 4

Trang 17

MLbase MLOpt MLbase aims to simplify development MLI and deployment of ML MLlib pipelines Apache Spark Spark: Cluster compuBng system designed for iteraBve computaBon MLlib: Spark’s core ML library MLI: API to simplify ML development MLOpt: DeclaraBve layer that aims to automate ML pipeline construcBon via search over feature extractors and models 4

Trang 18

MLbase MLOpt MLbase aims to simplify development MLI and deployment of ML MLlib MLOpt and MLI arepipelines Apache Spark Spark: Cluster compuBng system designed for iteraBve computaBonexperimental testbeds MLlib: Spark’s core ML library MLI: API to simplify ML development MLOpt: DeclaraBve layer that aims to automate ML pipeline construcBon via search over feature extractors and models 4

Trang 20

MLlib + Scalable and fast + Simple development environment + Part of Spark’s robust ecosystem MLlib GraphX Spark SparkSQL (machine (graph) Streaming learning) Apache Spark 6

Hiển thị 20 trang đầu. Tải tài liệu để xem đầy đủ.

Bình luận (0)

Đăng nhập để tham gia bình luận

Chưa có bình luận nào. Hãy là người đầu tiên!

Tài liệu liên quan

Partitioning of Relational Databases (05) (Phân vùng cơ sở dữ liệu quan hệ)

Miễn phí347 trang

Big Data Analytics Overview (00) (Tổng quan về dữ liệu lớn và các khái niệm cơ bản)

Miễn phí258 trang

[Bài giảng] Advanced Big Data Analytics (Lecture 6) - Phân tích Dữ liệu lớn nâng cao

Miễn phí281 trang

How hadoop works (Cách MapReduce hoạt động trong Hadoop) (Tiếng Anh)

Miễn phí226 trang

Big Data Analytics - Phân tích dữ liệu lớn (Lecture 4)

Miễn phí194 trang
Cùng tác giả

Giáo trình Pháp luật đại cương 2021 - ĐH Thương Mại

Miễn phí0237 trang

Đề thi môn Đại số tuyến tính (NN2) (Kèm đáp án)

Premium38 trang

Luyện dạng thường gặp - Toán (HSA) - Dạng 1

Miễn phí74 trang

Đề khảo sát tháng 8 - Đề VACT Toán (Có đáp án chi tiết)

Miễn phí1311 trang

TSAP Thi thử đợt trải nghiệm - Toán

Premium912 trang