api-server did not start

[Pavaniaddanki]

I am facing issue while installing Contrail 3.2. ./contrail.sh start step is failing with the error :

api-server did not start. Can anyone help me in resolving this error.

2017-05-05 14:13:49 ++ screen -S contrail -p ifmap -X stuff 'cd /opt/stack/contrail/build/packages/ifmap-server; java -jar ./irond.jar & echo $! >/home/controller/contr'il-installer/status/contrail/ifmap.pid; fg || echo "ifmap failed to start" | tee "/home/controller/contrail-installer/status/contrail/ifmap.failure"
2017-05-05 14:13:49 ++ [[ ifmap == \a\g\e\n\t ]]
2017-05-05 14:13:49 ++ sleep 2
2017-05-05 14:13:51 ++ RABBIT_OPTS='--rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 10.139.2.32'
2017-05-05 14:13:51 +++ which contrail-api
2017-05-05 14:13:51 ++ screen_it apiSrv '/usr/bin/contrail-api --conf_file /etc/contrail/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 10.139.2.32'
2017-05-05 14:13:51 ++ SCREEN_NAME=contrail
2017-05-05 14:13:51 ++ SERVICE_DIR=/home/controller/contrail-installer/status
2017-05-05 14:13:51 +++ trueorfalse False True
2017-05-05 14:13:51 +++ local default=False
2017-05-05 14:13:51 +++ local testval=True
2017-05-05 14:13:51 +++ [[ -z True ]]
2017-05-05 14:13:51 +++ [[ 0 no No NO false False FALSE =~ True ]]
2017-05-05 14:13:51 +++ [[ 1 yes Yes YES true True TRUE =~ True ]]
2017-05-05 14:13:51 +++ echo True
2017-05-05 14:13:51 +++ return
2017-05-05 14:13:51 ++ USE_SCREEN=True
2017-05-05 14:13:51 ++ is_service_enabled apiSrv
2017-05-05 14:13:51 ++ services=apiSrv
2017-05-05 14:13:51 ++ for service in '${services}'
2017-05-05 14:13:51 ++ [[ ,named,dns,redis,cass,zk,ifmap,disco,apiSrv,schema,svc-mon,control,collector,analytics-api,query-engine,agent,redis-w,ui-jobs,ui-webs,kafka,alarm, =~ ,apiSrv, ]]
2017-05-05 14:13:51 ++ return 0
2017-05-05 14:13:51 ++ screen_rc apiSrv '/usr/bin/contrail-api --conf_file /etc/contrail/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 10.139.2.32'
2017-05-05 14:13:51 ++ SCREEN_NAME=contrail
2017-05-05 14:13:51 ++ SCREENRC=/home/controller/contrail-installer/contrail-screenrc
2017-05-05 14:13:51 ++ [[ ! -e /home/controller/contrail-installer/contrail-screenrc ]]
2017-05-05 14:13:51 ++ grep apiSrv /home/controller/contrail-installer/contrail-screenrc
2017-05-05 14:13:51 ++ [[ True = \T\r\u\e ]]
2017-05-05 14:13:51 ++ screen -S contrail -X screen -t apiSrv
2017-05-05 14:13:51 ++ [[ -n /home/controller/contrail-installer/log/screens ]]
2017-05-05 14:13:51 ++ screen -S contrail -p apiSrv -X logfile /home/controller/contrail-installer/log/screens/screen-apiSrv.2017-05-05-141328.log
2017-05-05 14:13:51 ++ screen -S contrail -p apiSrv -X log on
2017-05-05 14:13:51 ++ ln -sf /home/controller/contrail-installer/log/screens/screen-apiSrv.2017-05-05-141328.log /home/controller/contrail-installer/log/screens/screen-apiSrv.log
2017-05-05 14:13:51 ++ sleep 1.5
2017-05-05 14:13:52 +++ echo -ne '\015'
2017-05-05 14:13:52 ++ NL=$'\r'
2017-05-05 14:13:52 Waiting for api-server to start...
2017-05-05 14:13:52 ++ screen -S contrail -p apiSrv -X stuff '/usr/bin/contrail-api --conf_file /etc/contrail/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 10.139.2.32 & echo $! >/home/controller/contrail-installer/status/contrail/apiSrv.pid; fg || echo "apiSrv failed to st'rt" | tee "/home/controller/contrail-installer/status/contrail/apiSrv.failure"
2017-05-05 14:13:52 ++ [[ apiSrv == \a\g\e\n\t ]]
2017-05-05 14:13:52 ++ echo 'Waiting for api-server to start...'
2017-05-05 14:13:52 ++ timeout 180 sh -c 'while ! http_proxy= wget -q -O- http://10.139.2.32:8082; do sleep 1; done'

controller@controller:/contrail-installer$
controller@controller:/contrail-installer$ 2017-05-05 14:16:52 api-server did not start
2017-05-05 14:16:52 ++ echo 'api-server did not start'

[Pavaniaddanki]

Did anyone fix this issue. If yes, please help with the steps.

[ulistack]

same problem here

[Groundsea]

I met the same problem in ubuntu 14.04 + opencontrail 3.2.2.
below is the log of screen-apiSrv.log
xhf@Contrail:~/contrail-installer$ /usr/bin/contrail-api --conf_file /etc/contra ^Mil/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_passwo ^Mrd contrail123 --rabbit_server 127.0.0.1 & echo $! >/home/xhf/contrail-installer ^M/status/contrail/apiSrv.pid; fg || echo "apiSrv failed to start" | tee "/home/xh ^Mf/contrail-installer/status/contrail/apiSrv.failure"
[1] 6064
/usr/bin/contrail-api --conf_file /etc/contrail/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 127.0.0.1
07/11/2017 02:02:52 PM [contrail-api]: SANDESH: CONNECT TO COLLECTOR: True
INFO:contrail-api:SANDESH: CONNECT TO COLLECTOR: True
07/11/2017 02:02:52 PM [contrail-api]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE]
INFO:contrail-api:SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE]
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: Connecting to ifmap on 127.0.0.1:8443 as api-server
ERROR:contrail-api:Starting Introspect on HTTP Port 8084
ERROR:contrail-api:Cannot write http_port 8084 to /tmp/contrail-api.5942.http_port
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: IFMAP connection ESTABLISHED
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: Connecting to cassandra on ['127.0.0.1:9160']
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: Cassandra connection ESTABLISHED
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: Connecting to zookeeper on 127.0.0.1
INFO:api-0:Connecting to 127.0.0.1:2181
INFO:api-0:Zookeeper connection established, state: CONNECTED
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: Initializing RabbitMQ connection, urls ['pyamqp://rabbitcontrail:[email protected]:5672/']
ERROR:contrail-api:No Connection: default [SYS_ERR]: VncApiError: RabbitMQ connection down
WARNING:contrail-api:No Connection: default [SYS_NOTICE]: VncApiError: RabbitMQ connection ESTABLISHED <Connection: amqp://[email protected]:5672// at 0x7ffb024aa990>
ERROR:contrail-api:Connect error to contrail api 100 tries:
ERROR:contrail-api:Connect error to contrail api 200 tries:
ERROR:contrail-api:Connect error to contrail api 300 tries:
ERROR:contrail-api:Connect error to contrail api 400 tries:
ERROR:contrail-api:Connect error to contrail api 500 tries:
ERROR:contrail-api:Connect error to contrail api 600 tries:
ERROR:contrail-api:Connect error to contrail api 700 tries:
ERROR:contrail-api:Connect error to contrail api 800 tries:
ERROR:contrail-api:Connect error to contrail api 900 tries:
ERROR:contrail-api:Connect error to contrail api 1000 tries:
ERROR:contrail-api:Connect error to contrail api 1100 tries:

I don't understand the following 2 lines error information, 8084 port is used by contrail-api itself, why it can not write? And I don't find the file contrail-api.5942.http_port under /tmp.
ERROR:contrail-api:Starting Introspect on HTTP Port 8084
ERROR:contrail-api:Cannot write http_port 8084 to /tmp/contrail-api.5942.http_port

Another error line is:
ERROR:contrail-api:No Connection: default [SYS_ERR]: VncApiError: RabbitMQ connection down
I have checked the rabbitmq-server, the status is ok, I have restart the rabbitmq, but it didn't take effect.

Does anyone know this problem?

Thank you very much!

[mccormickt12]

Same problem...

2017-07-20 03:45:32 ++ services=apiSrv
2017-07-20 03:45:32 Use -S to specify a session.
2017-07-20 03:45:32 ++ for service in '${services}'
2017-07-20 03:45:32 There are several suitable screens on:
2017-07-20 03:45:32 ++ [[ ,named,dns,redis,cass,zk,ifmap,disco,apiSrv,schema,svc-mon,control,collector,analytics-api,query-engine,agent,redis-w,ui-jobs,ui-webs,kafka,alarm, =~ ,apiSrv, ]]
2017-07-20 03:45:32 28264.contrail (07/20/17 03:45:21) (Detached)
2017-07-20 03:45:32 ++ return 0
2017-07-20 03:45:32 19783.contrail (07/20/17 00:01:56) (Attached)
2017-07-20 03:45:32 ++ screen_rc apiSrv '/usr/bin/contrail-api --conf_file /etc/contrail/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 127.0.0.1'
2017-07-20 03:45:32 8125.contrail (07/19/17 23:38:54) (Detached)
2017-07-20 03:45:32 ++ SCREEN_NAME=contrail
2017-07-20 03:45:32 5869.contrail (07/19/17 23:18:59) (Detached)
2017-07-20 03:45:32 ++ SCREENRC=/home/ubuntu/contrail-installer/contrail-screenrc
2017-07-20 03:45:32 2507.contrail (07/19/17 22:33:58) (Detached)
2017-07-20 03:45:32 ++ [[ ! -e /home/ubuntu/contrail-installer/contrail-screenrc ]]
2017-07-20 03:45:32 123414.contrail (07/19/17 17:42:17) (Detached)
2017-07-20 03:45:32 ++ grep apiSrv /home/ubuntu/contrail-installer/contrail-screenrc
2017-07-20 03:45:32 113313.contrail (07/19/17 17:36:08) (Detached)
2017-07-20 03:45:32 ++ [[ True = \T\r\u\e ]]
2017-07-20 03:45:32 88346.contrail (07/19/17 03:31:10) (Detached)
2017-07-20 03:45:32 ++ screen -S contrail -X screen -t apiSrv
2017-07-20 03:45:32 86286.contrail (07/19/17 03:26:50) (Detached)
2017-07-20 03:45:32 ++ [[ -n /home/ubuntu/contrail-installer/log/screens ]]
2017-07-20 03:45:32 3028.contrail-installer (07/18/17 23:24:39) (Attached)
2017-07-20 03:45:32 ++ screen -S contrail -p apiSrv -X logfile /home/ubuntu/contrail-installer/log/screens/screen-apiSrv.2017-07-20-034521.log
2017-07-20 03:45:32 Use -S to specify a session.
2017-07-20 03:45:32 ++ screen -S contrail -p apiSrv -X log on
2017-07-20 03:45:32 There are several suitable screens on:
2017-07-20 03:45:32 ++ ln -sf /home/ubuntu/contrail-installer/log/screens/screen-apiSrv.2017-07-20-034521.log /home/ubuntu/contrail-installer/log/screens/screen-apiSrv.log
2017-07-20 03:45:32 28264.contrail (07/20/17 03:45:21) (Detached)
2017-07-20 03:45:32 ++ sleep 1.5
2017-07-20 03:45:32 19783.contrail (07/20/17 00:01:56) (Attached)
2017-07-20 03:45:32 8125.contrail (07/19/17 23:38:54) (Detached)
2017-07-20 03:45:32 5869.contrail (07/19/17 23:18:59) (Detached)
2017-07-20 03:45:32 2507.contrail (07/19/17 22:33:58) (Detached)
2017-07-20 03:45:32 123414.contrail (07/19/17 17:42:17) (Detached)
2017-07-20 03:45:32 113313.contrail (07/19/17 17:36:08) (Detached)
2017-07-20 03:45:32 88346.contrail (07/19/17 03:31:10) (Detached)
2017-07-20 03:45:32 86286.contrail (07/19/17 03:26:50) (Detached)
2017-07-20 03:45:32 3028.contrail-installer (07/18/17 23:24:39) (Attached)
2017-07-20 03:45:32 Use -S to specify a session.
2017-07-20 03:45:33 +++ echo -ne '\015'
2017-07-20 03:45:33 ++ NL=$'\r'
2017-07-20 03:45:33 There are several suitable screens on:
2017-07-20 03:45:33 ++ screen -S contrail -p apiSrv -X stuff '/usr/bin/contrail-api --conf_file /etc/contrail/contrail-api.conf --reset_config --rabbit_user rabbitcontrail --rabbit_password contrail123 --rabbit_server 127.0.0.1 & echo $! >/home/ubuntu/contrail-installer'status/contrail/apiSrv.pid; fg || echo "apiSrv failed to start" | tee "/home/ubuntu/contrail-installer/status/contrail/apiSrv.failure"
2017-07-20 03:45:33 28264.contrail (07/20/17 03:45:20) (Detached)
2017-07-20 03:45:33 ++ [[ apiSrv == \a\g\e\n\t ]]
2017-07-20 03:45:33 19783.contrail (07/20/17 00:01:55) (Attached)
2017-07-20 03:45:33 ++ echo 'Waiting for api-server to start...'
2017-07-20 03:45:33 8125.contrail (07/19/17 23:38:53) (Detached)
2017-07-20 03:45:33 ++ timeout 180 sh -c 'while ! http_proxy= wget -q -O- http://localhost:8082; do sleep 1; done'
2017-07-20 03:45:33 5869.contrail (07/19/17 23:18:58) (Detached)
2017-07-20 03:45:33 2507.contrail (07/19/17 22:33:57) (Detached)
2017-07-20 03:45:33 123414.contrail (07/19/17 17:42:16) (Detached)
2017-07-20 03:45:33 113313.contrail (07/19/17 17:36:07) (Detached)
2017-07-20 03:45:33 88346.contrail (07/19/17 03:31:09) (Detached)
2017-07-20 03:45:33 86286.contrail (07/19/17 03:26:49) (Detached)
2017-07-20 03:45:33 3028.contrail-installer (07/18/17 23:24:38) (Attached)
2017-07-20 03:45:33 Use -S to specify a session.
2017-07-20 03:45:33 Waiting for api-server to start...
ubuntu@ip-172-31-29-235:/contrail-installer$
ubuntu@ip-172-31-29-235:/contrail-installer$
ubuntu@ip-172-31-29-235:~/contrail-installer$ 2017-07-20 03:48:33 api-server did not start
2017-07-20 03:48:33 ++ echo 'api-server did not start'
2017-07-20 03:48:33 exited with status :1
2017-07-20 03:48:33 ++ exit 1
2017-07-20 03:48:33 ++ clean
2017-07-20 03:48:33 ++ local r=1
2017-07-20 03:48:33 ++ echo 'exited with status :1'
2017-07-20 03:48:33 ++ exit 1

[Groundsea]

Here is my experence: at the beginning, I deployed contrail with PPA package, I met this question, API server could not start, when I manually started contrail-discovery service, this step was passed, api-server could start and listen on port 8082. but there were still a lot of problems need to be solved.

Then I try to deploy with newest source, this time I didn't start contrail-discovery service(and it seemed no contrail-discovery service be deployed this time), then api-srv is ok.

But I don't know why, and I also wish to know why this time there is no discovery service be deployed? Will it affect the service?