Can't run Docker container due device mapper error

device-mapper, docker, lvm, lxc

Solution

The following is for a Fedora/RHEL system, so you'll need to adjust for Debian...

# systemctl stop docker.service
# thin_check /var/lib/docker/devicemapper/devicemapper/metadata

If there were no errors then proceed with:

# thin_check --clear-needs-check-flag /var/lib/docker/devicemapper/devicemapper/metadata
# systemctl start docker.service
# docker run --name=fpm-5.3 debian:jessie

To install `thin_check` command, run:

# apt-get install -y thin-provisioning-tools

Problem

I just can't create and run new containers in Docker anymore. But in the same time a can run previously created containers. When I try to do something like this: ``` [user@host ~ ] docker run --name=fpm-5.3 debian:jessie 2014/07/12 07:34:08 Error: Error running DeviceCreate (createSnapDevice) dm_task_run failed ``` From docker.log: ``` 2014/07/12 05:57:11 POST /v1.12/containers/create?name=fpm-5.3 [f56fcb6f] +job create(fpm-5.3) Error running DeviceCreate (createSnapDevice) dm_task_run failed [f56fcb6f] -job create(fpm-5.3) = ERR (1) [error] server.go:1025 Error: Error running DeviceCreate (createSnapDevice) dm_task_run failed [error] server.go:90 HTTP Error: statusCode=500 Error running DeviceCreate (createSnapDevice) dm_task_run failed ``` dmsetup status ``` docker-8:1-1210426-pool: 0 209715200 thin-pool 352 2510/524288 205173/1638400 - ro discard_passdown queue_if_no_space ``` But they are a lot of free space on disk. dmsetup info ``` Name: docker-8:1-1210426-pool State: ACTIVE Read Ahead: 256 Tables present: LIVE Open count: 1 Event number: 1 Major, minor: 252, 0 Number of targets: 1 ``` docker info ``` Containers: 4 Images: 65 Storage Driver: devicemapper Pool Name: docker-8:1-1210426-pool Data file: /var/lib/docker/devicemapper/devicemapper/data Metadata file: /var/lib/docker/devicemapper/devicemapper/metadata Data Space Used: 12823.3 Mb Data Space Total: 102400.0 Mb Metadata Space Used: 9.9 Mb Metadata Space Total: 2048.0 Mb Execution Driver: native-0.2 Kernel Version: 3.14.4 ``` docker version ``` Client version: 1.0.0 Client API version: 1.12 Go version (client): go1.2.2 Git commit (client): 63fe64c Server version: 1.0.0 Server API version: 1.12 Go version (server): go1.2.2 Git commit (server): 63fe64c ```

Original source