Failure recovery (15) (Khôi phục lỗi trong hệ thống tính toán dữ liệu chuyên sâu) (Tiếng Anh)
Generating preview...
Tài liệu trình bày về khôi phục lỗi (failure recovery) trong hệ thống tính toán dữ liệu chuyên sâu, bao gồm các ràng buộc nhất quán, giao dịch và phương pháp ghi nhật ký hoàn tác.
Description
CPS216: Data-intensive Computing Systems Failure Recovery Shivnath Babu 1 Integrity or correctness of data Would like data to be “accurate” or “correct” at all times EMP Name Age White 52 Green 3421 Blue 1 2 Integrity or consistency constraints Predicates data must satisfy Examples: x is key of relation R x → y holds in R (functional dependency) Domain(x) = {Red, Blue, Green} a is valid index for attribute x of R no employee should make more than twice the average salary 3 Definition: Consistent state: satisfies all constraints Consistent DB: DB in consistent state 4 Constraints (as we use here) may not capture “full correctness” Example 1 Transaction constraints When salary is updated, new salary > old salary When account record is deleted, balance = 0 5 Note: could be “emulated” by simple constraints, e.g., account Acct # …. balance deleted? 6 Constraints (as we use here) may not capture “full correctness” Example 2 DB Database should reflect real world Reality 7 in any case, continue with constraints... Observation: DB cannot be consistent always! Example: a1 + a2 +…. an = TOT (constraint) Deposit $100 in a2: a2 a2 + 100 TOT TOT + 100 8 Example: a1 + a2 +…. an = TOT (constraint) Deposit $100 in a2: a2 a2 + 100 TOT TOT + 100 a2 TOT . . 50 . . 1000 . . 150 . . 1000 . . 150 . . 1100 9 Transaction: collection of actions that preserve consistency Consistent DB T Consistent DB’ 10 Assumption: If T starts with DB in consistent state + T executes in isolation T leaves DB in consistent state 11 Correctness (informally) If we stop running transactions, DB left consistent Each transaction sees a consistent DB 12 How can constraints be violated? Transaction bug DBMS bug Hardware failure e.g., disk crash alters balance of account Data sharing e.g.: T1: give 10% raise to programmers T2: change programmers systems analysts 13 How can we prevent/fix violations? Due to failure
AI summary
- Document name
- Failure recovery (15) (Khôi phục lỗi trong hệ thống tính toán dữ liệu chuyên sâu) (Tiếng Anh)
- School / Course
- Duke University · Big Data
- Content
- Tài liệu này trình bày các khái niệm cốt lõi về tính toàn vẹn dữ liệu, các loại ràng buộc, mô hình lỗi hệ thống và các kỹ thuật phục hồi lỗi, đặc biệt là trong bối cảnh các giao dịch và tính nguyên tử, sử dụng phương pháp ghi nhật ký.
- Table of contents
- Integrity or correctness of data
- Integrity or consistency constraints
- Definition: Consistent state
- Constraints (as we use here) may not capture “full correctness”
- Observation: DB cannot be consistent always!
- Transaction: collection of actions that preserve consistency
- Assumption: If T starts with DB in consistent state + T executes in isolation
- Correctness (informally)
- How can constraints be violated?
- How can we prevent/fix violations?
- Will not consider:
- Recovery
- Events
- Our failure model
- Undesired expected events:
- Undesired Unexpected:
- Is this model reasonable?
- Storage hierarchy
- Operations:
- Key problem Unfinished transaction
- Need atomicity: execute all actions of a transaction or none at all
- One solution: undo logging (immediate modification)
- Undo logging (Immediate modification)
- One “complication”
- Pages
- 62 pages
- Uploaded by
- Uni24h
Frequently asked questions
Is this document free?
Yes. “Failure recovery (15) (Khôi phục lỗi trong hệ thống tính toán dữ liệu chuyên sâu) (Tiếng Anh)” is free — just sign in and click Download to get the original file.
How many pages is this document?
The document has 62 pages, for the course Big Data. You can preview it online before downloading.
Can I preview before downloading?
Yes. You can preview this document right on this page with the online reader, then decide whether to download.
Failure recovery (15) (Khôi phục lỗi trong hệ thống tính toán dữ liệu chuyên sâu) (Tiếng Anh)
Generating preview...
CPS216: Data-intensive Computing Systems Failure Recovery Shivnath Babu 1 Integrity or correctness of data Would like data to be “accurate” or “correct” at all times EMP Name Age White 52 Green 3421 Blue 1 2 Integrity or consistency constraints Predicates data must satisfy Examples: x is key of relation R x → y holds in R (functional dependency) Domain(x) = {Red, Blue, Green} a is valid index for attribute x of R no employee should make more than twice the average salary 3 Definition: Consistent state: satisfies all constraints Consistent DB: DB in consistent state 4 Constraints (as we use here) may not capture “full correctness” Example 1 Transaction constraints When salary is updated, new salary > old salary When account record is deleted, balance = 0 5 Note: could be “emulated” by simple constraints, e.g., account Acct # …. balance deleted? 6 Constraints (as we use here) may not capture “full correctness” Example 2 DB Database should reflect real world Reality 7 in any case, continue with constraints... Observation: DB cannot be consistent always! Example: a1 + a2 +…. an = TOT (constraint) Deposit $100 in a2: a2 a2 + 100 TOT TOT + 100 8 Example: a1 + a2 +…. an = TOT (constraint) Deposit $100 in a2: a2 a2 + 100 TOT TOT + 100 a2 TOT . . 50 . . 1000 . . 150 . . 1000 . . 150 . . 1100 9 Transaction: collection of actions that preserve consistency Consistent DB T Consistent DB’ 10 Assumption: If T starts with DB in consistent state + T executes in isolation T leaves DB in consistent state 11 Correctness (informally) If we stop running transactions, DB left consistent Each transaction sees a consistent DB 12 How can constraints be violated? Transaction bug DBMS bug Hardware failure e.g., disk crash alters balance of account Data sharing e.g.: T1: give 10% raise to programmers T2: change programmers systems analysts 13 How can we prevent/fix violations? Due to failure
Read full document
- Document name
- Failure recovery (15) (Khôi phục lỗi trong hệ thống tính toán dữ liệu chuyên sâu) (Tiếng Anh)
- School / Course
- Duke University · Big Data
- Content
- Tài liệu này trình bày các khái niệm cốt lõi về tính toàn vẹn dữ liệu, các loại ràng buộc, mô hình lỗi hệ thống và các kỹ thuật phục hồi lỗi, đặc biệt là trong bối cảnh các giao dịch và tính nguyên tử, sử dụng phương pháp ghi nhật ký.
- Table of contents
- Integrity or correctness of data
- Integrity or consistency constraints
- Definition: Consistent state
- Constraints (as we use here) may not capture “full correctness”
- Observation: DB cannot be consistent always!
- Transaction: collection of actions that preserve consistency
- Assumption: If T starts with DB in consistent state + T executes in isolation
- Correctness (informally)
- How can constraints be violated?
- How can we prevent/fix violations?
- Will not consider:
- Recovery
- Events
- Our failure model
- Undesired expected events:
- Undesired Unexpected:
- Is this model reasonable?
- Storage hierarchy
- Operations:
- Key problem Unfinished transaction
- Need atomicity: execute all actions of a transaction or none at all
- One solution: undo logging (immediate modification)
- Undo logging (Immediate modification)
- One “complication”
- Pages
- 62 pages
- Uploaded by
- Uni24h
Comments (0)
No comments yet. Be the first!
Neumann (mối quan hệ giữa Exascale Computing và Big Data) - Philipp Neumann
Tính toán trong bộ nhớ với Spark - Julian M. Kunkel
Intro to Mapreduce (02) (Giới thiệu về MapReduce và Hadoop) (Tiếng Anh)
GPUs (04) (Xử lý song song và bộ xử lý đồ họa)
Neo4j (08) (Xử lý đồ thị với Neo4j) - BigData Analytics - Julian M. Kunkel
Chương 7.Cơ học lượng tử - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 6.Quang học lượng tử - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 5.Thuyết tương đối - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 4. Tán xạ ánh sáng - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 3.Phân cực ánh sáng - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Comments (0)
No comments yet. Be the first!