linnealovespie/data-engineering-zoomcamp
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
685 Commits 6 Branches 0 Tags
LO_Module1
Commit Graph

22 Commits

Author SHA1 Message Date
Fozan Talat
f4cc1dc33b Update windows.md (#335) 
changed spark version from 3.0.3 to the  3.3.2
 2023-02-26 22:20:26 +01:00
Grzegorz Sajko
52277cce88 Update linux.md (#324) 
corrected url, made spark versions consistent
 2023-02-25 12:16:48 +01:00
Eliton D. Gadotti
258415077b Update macos.md (#332) 
* Update macos.md

added a useful information regarding the path where java is installed, if someone has problems to find it

* Update macos.md

again, just made clear how to get the path to the installation (spark)
 2023-02-25 12:16:15 +01:00
Sebastian
7f52481821 Update linux.md (#329) 
* Update linux.md

Consistent changes.

* Update linux.md

---------

Co-authored-by: Alexey Grigorev <alexeygrigorev@users.noreply.github.com>
 2023-02-23 10:22:03 +01:00
Manoj Kolpe
2c4461668a Typo while exporting the spark path (#294) 
installed spark version is 3.3.1, however, exporting the path to the bash file is with version 3.3.0, so the exporting spark version is updated to 3.3.1
Previously

```bash
export SPARK_HOME="${HOME}/spark/spark-3.3.0-bin-hadoop3"
export PATH="${SPARK_HOME}/bin:${PATH}"
```
Updated
```bash
export SPARK_HOME="${HOME}/spark/spark-3.3.1-bin-hadoop3"
export PATH="${SPARK_HOME}/bin:${PATH}"
```
 2023-02-08 20:17:22 +01:00
Alexey Grigorev
af8b8ff5ed Merge branch 'main' of github.com:DataTalksClub/data-engineering-zoomcamp 2023-01-10 10:26:03 +01:00
Michael Shoemaker
5867e0d71f Updated Spark Version in Linux Instructions (#220) 2022-12-29 11:32:48 +01:00
Michael Shoemaker
518ad3f77a Updated spark version for Linux install (#211) 2022-09-20 05:51:48 +02:00
Alexey Grigorev
73ae05e4d7 hadoop 2022-04-22 15:06:10 +02:00
Alexey Grigorev
0ab54d899b Update macos.md 2022-03-02 17:51:37 +01:00
AmeyKokane
a2b6af4680 Added JAVA_HOME env var to avoid no JRE found error (#101) 2022-03-02 17:40:54 +01:00
Alexey Grigorev
433e379a94 Update pyspark.md 2022-02-22 19:46:41 +01:00
Senthilkumar Gopal
9f40637c86 Added a note for different file names for py4j (#96) 
Added a note since brew picks up the latest minor version and the filename might not match the version installed for the PYTHONPATH.
 2022-02-22 19:44:28 +01:00
ShuraZeryck
329cdaf5b3 Update linux.md (#95) 2022-02-22 19:35:36 +01:00
ShuraZeryck
ac444c887e Edit linux.md (#94) 
Edit JAVA_HOME and SPARK_HOME to match video example
 2022-02-22 11:38:29 +01:00
YungTaxReturn13
68f03b11a6 Update macos.md (#93) 2022-02-21 20:01:05 +01:00
louis-233
34f5827e5c Remove cask for brew cask install java. (#89) 
I believe using `brew cask` here is incorrect (at least for me it didn't work)
1. `cask` has been deprecated since version `2.6.0` (see [changelog](https://brew.sh/2020/12/01/homebrew-2.6.0/))
2. `brew install --cask java` does not work either (no cask `java`), but `brew install java` does work
 2022-02-20 20:09:01 +01:00
Alexey Grigorev
41c6d766de Update macos.md 2022-02-18 08:56:57 +01:00
IremErturk
760d222036 spark setup for MacOs (#85) 
* spark setup for macos

* added bash blocks
 2022-02-18 08:51:53 +01:00
Alexey Grigorev
39bbbe59ae Update windows.md 2022-02-16 20:56:47 +01:00
Alexey Grigorev
bfe1e836c1 setup 2022-02-15 20:24:59 +01:00
Alexey Grigorev
3d10464f5a setting up spark on Windows and Linux 2022-02-15 20:23:08 +01:00