Deployment Automation with Docker
3 likes•2,310 views
This document discusses deployment automation using Docker. It begins by introducing Docker terminology like images, containers, and registries. It then covers installing Docker, building images from Dockerfiles, tagging and pushing images to private registries, and running containers. The document also discusses mounting host directories in containers, cluster operations, and next steps around orchestration, monitoring, and continuous delivery.
![FROM ubuntu:14.04
# Install Python Setuptools
RUN apt-get install -y python-setuptools
# Install pip
RUN easy_install pip
# Bundle app source
COPY . /src
# Add and install Python modules
RUN pip install -r /src/requirements.txt
# Set default container command
ENTRYPOINT ["python"]
# Run the app
CMD ["/src/server.py"]
Dockerfile /project
requirements.txt
server.py
Dockerfile
/usr/user
/src
req-s.txt
server.py
ubuntu
python-setuptools
pip
requirements
Project source code
docker build -t image_x .
image_x
Image
Storage
<none>
IMAGE
CHARACTERISTICS
Deterministic
Independent
docker run ... image_x
/usr/user
/src
req-s.txt
server.py
ubuntu
...
<none>
<none>
<none>
Container r/w layer
Running
Container](https://image.slidesharecdn.com/dockerdemo-150202193148-conversion-gate02/85/Deployment-Automation-with-Docker-15-320.jpg)
Deployment Automation with Docker
- 1. Deployment Automation Egor Pushkin egor@glympse.com Platform Architect Glympse, Inc.
- 3. Docker is not intended to solve EVERYTHING
- 5. Terminology Docker Registry Docker Image Docker Daemon Docker Instance Docker Image Docker Container * * 1 1 1 * Storage backend Local volume, S3, etc. Registry Instance Docker Client Docker Client
- 7. Flow Docker Registrypush image_x dev. box / Jenkins / CD InstanceSource Code Env / Deps Configuration Instance pull image_x Docker Image run image_x 1 2 3
- 8. Image Anatomy Base Image Updates Dependencies Application Base Image Updates Dependencies Application Images bootfs Base Image Image Image Image r/o r/o r/o r/o r/o App I/O r/w Container Union file system Union mount Parent
- 9. Linux Containers (LXC) OS Kernel ... Container Container Container Docker daemon Multi CPU/core box cgroups Resource isolation â—Ź CPU â—Ź memory â—Ź disk I/O Namespace isolation â—Ź process tree â—Ź network â—Ź user ids â—Ź mounted file systems OS Kernel Docker ... Container Container Container There is no virtualization involved when software runs within containers. (2007)
- 10. Docker Registry Docker Registry Docker Image dev / test / staging / production *1 Storage backend Local volume, S3, etc.TCP-based API REST API REST API Docker Daemon Jenkins/CD/ automation software Containers Containers Containers
- 11. Registry Options Docker Hub Docker daemon Public Images Private Images Private Registry Private Cloud default
- 12. Private Registry Registry container nginx container Docker Hub Not secure / unauthenticated pull registry pull nginx SSL Basic Auth InternetVPC Docker Instance S3 Bucket
- 13. Starting Registry docker run --restart=always -e SETTINGS_FLAVOR=s3 -e AWS_BUCKET= registry.docker.enterprise.glympse.com -e STORAGE_PATH= /storage -e AWS_KEY= AKIA... -e AWS_SECRET= OEJ0... -e SEARCH_BACKEND=sqlalchemy -p 5000:5000 -d registry Registry container Docker Instance S3 Bucket docker pull registry :5000 :5000
- 15. FROM ubuntu:14.04 # Install Python Setuptools RUN apt-get install -y python-setuptools # Install pip RUN easy_install pip # Bundle app source COPY . /src # Add and install Python modules RUN pip install -r /src/requirements.txt # Set default container command ENTRYPOINT ["python"] # Run the app CMD ["/src/server.py"] Dockerfile /project requirements.txt server.py Dockerfile /usr/user /src req-s.txt server.py ubuntu python-setuptools pip requirements Project source code docker build -t image_x . image_x Image Storage <none> IMAGE CHARACTERISTICS Deterministic Independent docker run ... image_x /usr/user /src req-s.txt server.py ubuntu ... <none> <none> <none> Container r/w layer Running Container
- 16. Walkthrough docker build -t IMAGE_NAME . docker tag IMAGE_ID REGISTRY_URL:PORT/IMAGE_NAME:TAG docker push REGISTRY_URL:PORT/IMAGE_NAME:TAG docker pull REGISTRY_URL:PORT/IMAGE_NAME:TAG docker run --restart=always -d -p HOST_PORT:CONTAINER_PORT IMAGE_NAME:TAG Build image from source Tag image appropriately Push image to the registry Pull image from the registry Run container based on the image Dev box Jenkins CD Prod Staging Test
- 17. Container Configuration Docker Instance Container Container portHost port /src/dir Host FS Container FS /opt/dir Configure port mapping docker run ... -p HOST_PORT:CONTAINER_PORT docker run ... -v HOST_DIR:CONTAINER_DIR Mount a host directory as a data volume
- 18. Instance En Route Deployment Demo Admin Console web app Backend App api servers LB Instance App LB Instance Instance ... DB
- 19. feature/ec2_demo user name user@email Logout Admin Console ip:pid API Servers /any/thing http://169.254.169.254/ latest/meta-data/public-ipv4 OM { ... box: { ip: IP, pid: PID } } os.getPid()
- 20. Instance Template Dockerized Application App PORT -> Instance PORT Instance Docker daemon Container Configuration environment variables Registry pull image aws ec2 run-instances ... EC2Connection.run_instances(... CloudFormationConnection. create_stack(... { "Parameters" : { ... }, "Resources" : { ... }, "Outputs" : { ... } } AWS CLI AWS SDK AWS SDK CloudFormatio n
- 21. Cluster Operations Load Balancer App Instance App Instance App Instance App Instance App Instance api - tracking - engine web - tracking - admin type NS app cluster_create cluster_delete cluster_details cluster_launch_instance cluster_terminate_instance cluster_register_instance cluster_deregister_instance Cluster Structure Clusters Operations https://github.com/Glympse/CommonTools/tree/master/Docker Cluster management scripts can be found here
- 22. Next â—Ź Orchestration â—Ź SSL / Authentication â—Ź Configuration (identity, networking) â—Ź Monitoring (health checks) â—Ź Continuous delivery