Course Details
Topic 2: Exploring Data
- Data Interface
- RDD Basic Operations
- Import Data
- Actions and Transformations
- Saving Results
Topic 3: Analyzing Data
- Select and FIlter Data
- Aggregate Data
- Save Data
Topic 4: SparkSQL
- Creating Tables
- Querying Data
- Visualizing Data
Topic 5: Machine Learning
- ML or MLlib Module
- Preprocessing Data
- Linear Regression
- Classification
Topic 6: Spark Streaming
- Streaming Setup
- Querying Streaming Data
Course Info
Prerequisite
This is a intermediate course. Participants should have basic knowledge on the following subjects:
- Python
- Apache Spark
Software Requirement
Download and unzip Apache Spark https://spark.apache.org/downloads.html.
HRDF Funding
Please refer to this video https://youtu.be/Kzpd-V1F9Xs
1- HRD Corp Grant Helper
How to submit grant applications for HRD Corp Claimable Courses
2- Employers are required to apply for the grant at least one week before training commences.
Employers must submit their applications with supporting documents, including invoices/quotations, trainer profiles, training schedule and course content.
3- First, Login to Employer’s e-TRIS account -https://etris.hrdcorp.gov.my
Second, Click Application
4- Click Grant on the left side under Applications
5- Click Apply Grant on the left side under Applications
6- Click Apply
7- Choose a Scheme Code and select HRD Corp Claimable Courses: Skim Bantuan Latihan Khas. Then, click Apply
8- Scheme Code represents all types of training that suit the requirements provided by HRD Corp. Below are the list of schemes offered by HRD Corp:
9- Select your Immediate Officer and click Next
10- Select a Training Provider, then click Next
11- Please select a training programme from the list, then key in all the required details and click Next
Select your desired training programme.
Give an explanation on why the participant is required to attend the training. E.g., related to their tasks/ career development, etc.
Explain the background and objective of this training.
Select a relevant focus area. For Employer-Specific Courses, select ‘Not Applicable’.
12- If the training programme is a micro-credential programme, you are required to complete these 3 fields. Save and click Next
Insert MiCAS Application number
13- Based on the nine (9) pillars listed below, HRD Corp Focus Area Courses are closely tied to support government initiatives towards nation building. As such, courses offered through the HRD Corp Focus Areas are designed to provide the workforce with skills required for current and future demands. Details of the focus areas are as follows:
14- Please select a Course Title and Type of Training
15- Select the correct type of training according to the actual type of training, or as mentioned in the training brochure:
16- Please key in the Training Location and click Next
17- Please select the Level of Certification and click Next
18- Please follow the instructions and key in trainee details
19- Click Add Batch, then click Save
20- Click Add Trainee Details
21- Please key in all the required details, then click Add
22- Click Add if there are more participants. Once done, click Save
23- Click Next
24- Please key in the course fees and allowance details, then click Save
25- Estimated cost includes the course fees/external trainer fees, allowances, and consumable training materials. Please comply with the HRD Corp Allowable Cost Matrix.
26- Select Upfront Payment to Training Provider and key in the percentage from 0% to 30%. Then, click Save and Next
27- Complete the declaration form and select a desired officer
28- Add all the required documents, then click Add Attachment. Then, click Save and Submit Application
29- Once the New Grant Application is successfully submitted, the Grant Officer will evaluate the application accordingly. The application may be queried if additional information is required.
The application status will be updated via the employer’s dashboard, email, and the e-TRiS inbox.
Job Roles
- Data Scientist
- Big Data Engineer
- Data Analyst
- Machine Learning Engineer
- Business Intelligence Developer
- Research Analyst
- Software Engineer
- Back-end Developer
- Data Architect
- Full Stack Developer
- System Analyst
- Cloud Architect
- IT Manager
- Database Administrator
- DevOps Engineer
Trainers
Saeid: Saeid is co-founder of Skymics sdn bhd, he has 8 years experience in field of IOT (Internet of things) and Information Technology. He is a certified IBM IoT Practitioner and instructor and Certified Citizen Data Scientist Train-The-Trainer. He has been co-inventors of 3 inventions during the last 4 years.
He has worked across wide domains such as, data analytics, IoT, social media analytics, smart cities energy management, smart plantations. In addition, 5+ years of experience in data processing, visualization, and analytics. He is expert in Power BI, Qlikview, and Tableau.
Lee Cheong Loong: Lee Cheong Loong, Manager with 23 years working experience in multiple role and department, He completed HRD Corp Train the Trainer programme, HRD Corp Accredited Trainer, Microsoft Certified Trainer and CPFA Citizen Data scientist Trainer programme. with Professional certificate in Big Data & Analytics, Microsoft Office Specialist -Excel 2016 and Tableau Desktop Specialist. He also deliver training for R & Python programming, Excel Dashboard for Business analysis, Data Visualization with Tableau, and Microsoft PowerBI, and Citizen Data Scientist (OpenCertHub).
Raj R: Raj R has more than 10 years, experience in architecting solutions in , Big Data , Data Analytics, Data Science , Artificial Intelligence , Machine Learning, IoT, and system integration.He has being coaching SQL, No-SQL, distributed applications (cloud /on-premise) , software methodologies, and integration tools.
Customer Reviews (2)
- will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - might recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment