Autonomous car

A very accessible project on autonomous cars using ML

New

• Added line follower functionality to train faster and without assistance(no need to drive same path endlessly).
• Added pid functionality to remove erratic movements of steering servo. Change PID values to suit your car.
• Added Keyboard control for linux OS systems.

Table of Contents

1. About The Project
   • Built With
2. Getting Started
   • Prerequisites
   • Assembling the car
   • Installation
   • Training
3. Contributing
4. Contact
5. References

About The Project

There are many autonomous car projects on GitHub, however, many of those require costly hardware or it is just a simulation. I want everyone who is interested in AI, ML and autonomous vehicles to have hands on approach on building, training and deploying a autonomous vehicle.

Key Features:

• This porject uses very cheap off the shelf items to build your own autonomous car.
• Easy to understand and train your own AI models.

Of course there are plug and play systems which you can buy, But those are very costly or you need a CS degree from MIT to understand the documentation, which can be little intimidating for bigginers. I was one of those guys. So here's my Project. Thanks to all the people who have contributed to expanding this project and thanks for using it.

A list of commonly used resources that I find helpful are listed in the acknowledgements.

Built With

• MicroPython
• python
• Arduino
• alexnet

Getting Started

We will start with things required to build your car and how to setup the project locally on your device.

Prerequisites

• Knowledge on how to work with MicroPython on ESP32 or any other Micropython compitable development board.
• Comfortable with soldering on PCB board.
• Basic knowledge in arduino programming.
• Basic knowledge in python programming.

Assembling the car

Follow this link on how to assemble a car for this project.

Installation

1. Clone the repo

   git clone https://github.com/rakesh-i/ESP32-Autonomous-car

2. Install MicroPyhon on ESP32

   Follow this link to flash MicroPython on ESP32.

3. Copying files to ESP32

   • Connect ESP32 to yoru PC, check on which com port esp32 is connected by going to device manager in Windows.. Open CMD terminal in ESP32 folder, which is in downloaded repo. Execute the followng command to connect to esp32.(repalce X with port number eg: COM5, COM9)

     rshell --port COMX

   • Copy files to esp32 one by one. (Remember to go through server.py and web.py to add wifi credentials and ip addresses. And PLEASE READ "wireless-setup.txt" how to do so. )

     cp boot.py /pyboard
     cp main.py /pyboard
     cp motor.py /pyboard
     cp server.py /pyboard
     cp web.py /pyboard

   • If you done every thing right till now, when you press EN button on esp32, you should see onboard led of esp32 lightup for 5 seconds notifying it is connected to the wifi.
   • You can type

     repl

     to open esp32 serial monitor. If you see connection successful message then you are good-to-go.
   • Now esp32 is wating for connection from client. Run client.py, which is in Client folder. If you see "Got connection from: 111.111.111.111, 11111" message then you have successfully established a tcp connection between your PC and ESP32.

4. Setting up ESP32 CAM

   • Follow this link to setup esp32-cam.

Training

Before you start, I would recommend you to watch this playlist on autonomous vehicles in GTA V game by Sentdex

1. Open Training folder from repo.

2. Turn on the car and put it on the track you have prepared.

3. Wait for onboard led of esp32 to turn off.

4. Check ESP32 CAM ip on network. Update the ip in VideoCapture(JUST THE IP DO NOT CHANGE ANYTHING!!! LEAVE :81/stream AS IT IS!! )

5. Start stream.py and start driving the car on the track. reduce the speed of car for greater control. Change values in motor.motorSpeed(x).(Max = 1000, min = 0)

6. Quit by pressing q when you are satisfied with your training or delete the "train_data.npy" and start again. I recommend around 20000 frames for your first model. You can see how many frames are recorded on terminal.

7. Now we need to balance our data. Run balance.py. It will create a file "balanced.npy" with balanced data.

8. Reviewing training data.

   

9. Now time to train our AI model. You can change prameters which suits your requirements. But I recommend to leave as it is for beginners. Run train_model.py. It will create your model based on your trainning data. Ihave trained mine on 2000 data points after balancing the data.

Testing

If you have done everything right upto this point your autonomous car is ready for its first autonomous steps.

• If you are running a good system you can turn up the speed of the car. Otherwise reduce the speed of car, so your system has time to process the data and produce predictions.
• Turn on your car and put it on the track.
• When car is ready to go, run "run.py".

Thats it, now your car should follow the track autonomously.

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

Contact

Rakesh Chavan - [email protected]

Project Link: https://github.com/rakesh-i/Autonomous-car/

References

• Sentdex GTA V autonomous vehicles
• MicroPython
• Arduino
• Clayton Darwin
• alexnet