mesos/apache aurora实战-安装手记

最新推荐文章于 2024-11-05 18:22:34 发布

原创最新推荐文章于 2024-11-05 18:22:34 发布 · 2k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#mesos #aurora

shell 专栏收录该内容

2 篇文章

订阅专栏

本文记录了在Cent OS 7.2环境下，使用mesosphere提供的Zookeeper安装包和mesos 0.28进行安装，以及手动编译aurora 0.13 RPM包的过程。详细介绍了mesos配置文件的读取顺序，包括/etc/default/mesos、/etc/default/mesos-master和/etc/mesos-master，以及aurora的配置文件/etc/sysconfig/aurora。此外，还阐述了如何启动mesos-master服务和aurora scheduler服务。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

环境cent os 7.2

mesosphere zookeeper 安装包(最新版本)

mesos 0.28 使用mesosphere cent安装包

aurora 0.13 自己编译rpm包

mesos 配置文件读取顺序:

/etc/default/mesos

/etc/default/mesos-master

/etc/mesos-master

mesos配置:

[root@10.10.110.65 x86_64]# ls /etc/mesos-master/
cluster  ip  quorum  roles  weights  work_dir

aurora 配置:

/etc/sysconfig/aurora

启动mesos 服务:

service mesos-master start

启动aurora scheduler:

service aurora start

修改过后的aurora scheduler配置:

#!/bin/bash
# Configuration used when executing the Aurora task scheduler process.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.


GLOG_v=0

LIBPROCESS_PORT=8083
LIBPROCESS_IP='10.10.110.65'

# Flags that control the behavior of the JVM.
JAVA_OPTS=(
  # Uses server-level GC optimizations, as this is a server.
  -server

  # Location of libmesos-XXXX.so / libmesos-XXXX.dylib
  -Djava.library.path='/usr/lib;/usr/lib64'
)

# Flags control the behavior of the Aurora scheduler.
# For a full list of available flags, run /usr/lib/aurora/bin/aurora-scheduler -help
AURORA_FLAGS=(
  # The name of this cluster.
  -cluster_name='mbdaurora'
  -hostname='10.10.110.65'

  # The HTTP port upon which Aurora will listen.
  -http_port=8081

  # The ZooKeeper URL of the ZNode where the Mesos master has registered.
  -mesos_master_address=$(cat /etc/mesos/zk)

  # The ZooKeeper quorum to which Aurora will register itself.
  -zk_endpoints=$(cut -d / -f 3 /etc/mesos/zk)

  # The ZooKeeper ZNode within the specified quorum to which Aurora will register its
  # ServerSet, which keeps track of all live Aurora schedulers.
  -serverset_path='/aurora/scheduler'

  # Allows the scheduling of containers of the provided type.
  -allowed_container_types='DOCKER,MESOS'

  ### Native Log Settings ###

  # The native log serves as a replicated database which stores the state of the
  # scheduler, allowing for multi-master operation.

  # Size of the quorum of Aurora schedulers which possess a native log.  If running in
  # multi-master mode, consult the following document to determine appropriate values:
  #
  # https://aurora.apache.org/documentation/latest/deploying-aurora-scheduler/#replicated-log-configuration
  -native_log_quorum_size=$(cat /etc/mesos-master/quorum)
  # The ZooKeeper ZNode to which Aurora will register the locations of its replicated log.
  -native_log_zk_group_path='/aurora/native-log'
  # The local directory in which an Aurora scheduler can find Aurora's replicated log.
  -native_log_file_path='/var/lib/aurora/scheduler/db'
  # The local directory in which Aurora schedulers will place state backups.
  -backup_dir='/var/lib/aurora/scheduler/backups'

  ### Thermos Settings ###

  # The local path of the Thermos executor binary.
  -thermos_executor_path='/usr/bin/thermos_executor'
  # Flags to pass to the Thermos executor.
  -thermos_executor_flags='--announcer-enable --announcer-ensemble '$(cut -d / -f 3 /etc/mesos/zk)
)

原始aurora配置(注意区别):

#!/bin/bash
# Configuration used when executing the Aurora task scheduler process.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.


GLOG_v=0

LIBPROCESS_PORT=8083
LIBPROCESS_IP='127.0.0.1'

# Flags that control the behavior of the JVM.
JAVA_OPTS=(
  # Uses server-level GC optimizations, as this is a server.
  -server

  # Location of libmesos-XXXX.so / libmesos-XXXX.dylib
  -Djava.library.path='/usr/lib;/usr/lib64'
)

# Flags control the behavior of the Aurora scheduler.
# For a full list of available flags, run /usr/lib/aurora/bin/aurora-scheduler -help
AURORA_FLAGS=(
  # The name of this cluster.
  -cluster_name='main'

  # The HTTP port upon which Aurora will listen.
  -http_port=8081

  # The ZooKeeper URL of the ZNode where the Mesos master has registered.
  -mesos_master_address='zk://127.0.0.1:2181/mesos'

  # The ZooKeeper quorum to which Aurora will register itself.
  -zk_endpoints='127.0.0.1:2181'

  # The ZooKeeper ZNode within the specified quorum to which Aurora will register its
  # ServerSet, which keeps track of all live Aurora schedulers.
  -serverset_path='/aurora/scheduler'

  # Allows the scheduling of containers of the provided type.
  -allowed_container_types='DOCKER,MESOS'

  ### Native Log Settings ###

  # The native log serves as a replicated database which stores the state of the
  # scheduler, allowing for multi-master operation.

  # Size of the quorum of Aurora schedulers which possess a native log.  If running in
  # multi-master mode, consult the following document to determine appropriate values:
  #
  # https://aurora.apache.org/documentation/latest/deploying-aurora-scheduler/#replicated-log-configuration
  -native_log_quorum_size='1'
  # The ZooKeeper ZNode to which Aurora will register the locations of its replicated log.
  -native_log_zk_group_path='/aurora/native-log'
  # The local directory in which an Aurora scheduler can find Aurora's replicated log.
  -native_log_file_path='/var/lib/aurora/scheduler/db'
  # The local directory in which Aurora schedulers will place state backups.
  -backup_dir='/var/lib/aurora/scheduler/backups'

  ### Thermos Settings ###

  # The local path of the Thermos executor binary.
  -thermos_executor_path='/usr/bin/thermos_executor'
  # Flags to pass to the Thermos executor.
  -thermos_executor_flags='--announcer-enable --announcer-ensemble 127.0.0.1:2181'
)