class: center, middle, inverse, title-slide # Working with Big Data in R --- exclude: true --- ## dplyr provides built-in SQL backend 1. Connects to DBMS’s 2. Transforms R code to SQL, sends to DBMS to run in DBMS 3. Collect results into R <img src="image/bk06_working-with-bigdata/using_dplyr.png" width="100%" style="display: block; margin: auto;" /> --- ## DB Connection <img src="image/bk06_working-with-bigdata/connect.png" width="100%" style="display: block; margin: auto;" /> --- ## Dplyr driver functions <img src="image/bk06_working-with-bigdata/SQLite.png" width="100%" style="display: block; margin: auto;" /> --- ## dplyr command to SQL <img src="image/bk06_working-with-bigdata/dplyr.png" width="100%" style="display: block; margin: auto;" /> --- ## Lazy Execution dplyr will only retrieve the first 10 rows of a query when you look at the output. <img src="image/bk06_working-with-bigdata/lazy.png" width="100%" style="display: block; margin: auto;" /> --- ## Collect <img src="image/bk06_working-with-bigdata/collect.png" width="100%" style="display: block; margin: auto;" /> --- ## collapse <img src="image/bk06_working-with-bigdata/collapse.png" width="100%" style="display: block; margin: auto;" /> --- ## Fit model <img src="image/bk06_working-with-bigdata/fit.png" width="100%" style="display: block; margin: auto;" /> --- ## copy to <img src="image/bk06_working-with-bigdata/copyto.png" width="100%" style="display: block; margin: auto;" /> --- ## close <img src="image/bk06_working-with-bigdata/close.png" width="100%" style="display: block; margin: auto;" /> --- ## alternative <img src="image/bk06_working-with-bigdata/alternative.png" width="100%" style="display: block; margin: auto;" /> --- ## <img src="image/bk06_working-with-bigdata/bigdata_visualization.png" width="100%" style="display: block; margin: auto;" />