clsn.io
Open in
urlscan Pro
2606:4700:3034::6815:3097
Public Scan
Submitted URL: http://176.251.134.61.adsl-pool.sx.cn/
Effective URL: https://clsn.io/clsn/lx1517.html
Submission Tags: falconsandbox
Submission: On January 18 via api from US — Scanned from DE
Effective URL: https://clsn.io/clsn/lx1517.html
Submission Tags: falconsandbox
Submission: On January 18 via api from US — Scanned from DE
Form analysis 1 forms found in the DOM
GET https://clsn.io/search/
<form id="search" action="https://clsn.io/search/" method="get" accept-charset="utf-8" target="_blank" _lpchecked="1">
<input type="text" name="q" maxlength="20" placeholder="Search">
<input type="hidden" name="sitesearch" value="https://clsn.io/">
<button type="submit" class="submit icon-search"></button>
</form>Text Content
CLSN - 惨绿少年博客
首页 归档 关于
KUBERNETES V1.15 二进制部署集群
2019年8月16日
| 📂Linux运维 📂云计算 📂安全 📂虚拟化
|94955 阅读
* 3.1.1 设置关闭防火墙及SELINUX
* 3.1.2 关闭swap
* 3.1.3 设置Docker所需参数
* 3.1.4 安装 Docker
* 3.1.5 创建相关目录
* 3.1.6 SSH 互信配置
* 3.1.7 添加 PATH 变量
* 3.2.1 安装及配置CFSSL
* 3.2.2 创建 ETCD 相关证书
* 3.2.3 创建 Kubernetes 相关证书
* 3.3.1 配置软件包
* 3.3.2 编辑etcd配置文件
* 3.3.3 创建 etcd的 systemd unit 文件
* 3.3.4 配置证书文件
* 3.3.5 配置文件拷贝到 节点1、节点2
* 3.3.6 启动ETCD服务
* 3.3.7 检查服务是否正常
* 3.4.1 向 etcd 写入集群 Pod 网段信息
* 3.4.2 部署 flannel
* 3.5.3 配置flannel
* 3.5.4 创建 flanneld 的 systemd unit 文件
* 3.5.5 配置Docker启动指定子网段
* 3.5.6 将flanneld systemd unit 文件到所有节点
* 3.5.7 验证fannel网络配置
* 3.5.1 配置 master 节点文件
* 3.5.2 配置 kubernetes相关证书
* 3.5.3 部署 kube-apiserver 组件
* 3.5.4 部署kube-scheduler
* 3.5.5 部署kube-controller-manager
* 3.5.6 查看master集群状态
* 3.6.1 部署 kubelet 组件
* 3.6.2 创建kubelet 参数配置文件拷贝到所有 nodes节点
* 3.6.3 启动kubelet服务
* 3.6.4 approve kubelet CSR 请求
* 3.6.5 查看集群状态
* 3.7.1 创建kube-proxy配置文件
* 3.7.2 创建kube-proxy systemd unit 文件
* 3.7.3 启动kube-proxy服务
* 3.7.4 检查服务运行状态
目录
1. 架构篇
1.1 KUBERNETES 架构说明
1.2 FLANNEL网络架构图
> 集群功能各模块功能描述：
> Master节点：
> Master节点上面主要由四个模块组成，APIServer，schedule,controller-manager,etcd
> APIServer: APIServer负责对外提供RESTful的kubernetes
> API的服务，它是系统管理指令的统一接口，任何对资源的增删该查都要交给APIServer处理后再交给etcd，如图，kubectl(kubernetes提供的客户端工具，该工具内部是对kubernetes
> API的调用）是直接和APIServer交互的。
> schedule:
> schedule负责调度Pod到合适的Node上，如果把scheduler看成一个黑匣子，那么它的输入是pod和由多个Node组成的列表，输出是Pod和一个Node的绑定。
> kubernetes目前提供了调度算法，同样也保留了接口。用户根据自己的需求定义自己的调度算法。
> controller manager: 如果APIServer做的是前台的工作的话，那么controller
> manager就是负责后台的。每一个资源都对应一个控制器。而control
> manager就是负责管理这些控制器的，比如我们通过APIServer创建了一个Pod，当这个Pod创建成功后，APIServer的任务就算完成了。
> etcd：etcd是一个高可用的键值存储系统，kubernetes使用它来存储各个资源的状态，从而实现了Restful的API。
>
> Node节点：
> 每个Node节点主要由三个模板组成：kublet, kube-proxy
> kube-proxy: 该模块实现了kubernetes中的服务发现和反向代理功能。kube-proxy支持TCP和UDP连接转发，默认基Round
> Robin算法将客户端流量转发到与service对应的一组后端pod。服务发现方面，kube-proxy使用etcd的watch机制监控集群中service和endpoint对象数据的动态变化，并且维护一个service到endpoint的映射关系，从而保证了后端pod的IP变化不会对访问者造成影响，另外，kube-proxy还支持session
> affinity。
> kublet：kublet是Master在每个Node节点上面的agent，是Node节点上面最重要的模块，它负责维护和管理该Node上的所有容器，但是如果容器不是通过kubernetes创建的，它并不会管理。本质上，它负责使Pod的运行状态与期望的状态一致。
1.3 KUBERNETES工作流程
>
2. 环境说明
2.1 部署节点说明
主机名 IP 用途 部署软件 k8s-1 192.168.123.211 master
apiserver,scheduler,controller-manager etcd,flanneld k8s-2 192.168.123.212 node
kubelet,kube-proxy etcd,flanneld k8s-3 192.168.123.213 node kubelet,kube-proxy
etcd,flanneld
2.2 操作系统环境
# 三台机器相同
[root@k8s-1 /root] master
# uname -r
3.10.0-957.el7.x86_64
[root@k8s-1 /root] master
# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)
[root@k8s-1 /root] master
# sestatus
SELinux status: disabled
2.3 软件包版本
软件包 下载地址 kubernetes-node-linux-amd64.tar.gz
https://dl.k8s.io/v1.15.1/kubernetes-node-linux-amd64.tar.gz
kubernetes-server-linux-amd64.tar.gz
https://dl.k8s.io/v1.15.1/kubernetes-server-linux-amd64.tar.gz
flannel-v0.11.0-linux-amd64.tar.gz
https://github.com/coreos/flannel/releases/download/v0.11.0/flannel-v0.11.0-linux-amd64.tar.gz
etcd-v3.3.10-linux-amd64.tar.gz
https://github.com/etcd-io/etcd/releases/download/v3.3.10/etcd-v3.3.10-linux-amd64.tar.gz
3. KUBERNETES 安装及配置
3.1 初始化环境
3.1.1 设置关闭防火墙及SELINUX
systemctl stop firewalld && systemctl disable firewalld
setenforce 0
vi /etc/selinux/config
SELINUX=disabled
3.1.2 关闭SWAP
swapoff -a && sysctl -w vm.swappiness=0
sed -i '/ swap / s/^\(.*\)$/#\1/g' /etc/fstab
3.1.3 设置DOCKER所需参数
cat > /etc/sysctl.d/kubernetes.conf <<EOF
net.ipv4.ip_forward=1
net.ipv4.tcp_tw_recycle=0
vm.swappiness=0
vm.overcommit_memory=1
vm.panic_on_oom=0
fs.inotify.max_user_watches=89100
fs.file-max=52706963
fs.nr_open=52706963
net.ipv6.conf.all.disable_ipv6=1
EOF
sysctl -p /etc/sysctl.d/kubernetes.conf
3.1.4 安装 DOCKER
# 配置yum源
cd /etc/yum.repo.d/
wget https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
yum clean all ;yum repolist -y
# 安装docker ，版本 18.06.2
yum install docker-ce-18.06.2.ce-3.el7 -y
# 启动
systemctl start docker && systemctl enable docker
3.1.5 创建相关目录
# 创建安装包存储目录
mkdir /data/{install,ssl_config} -p
mkdir /data/ssl_config/{etcd,kubernetes} -p
# 创建安装目录
mkdir /cloud/k8s/etcd/{bin,cfg,ssl} -p
mkdir /cloud/k8s/kubernetes/{bin,cfg,ssl} -p
3.1.6 SSH 互信配置
ssh-keygen
ssh-copy-id k8s-1
ssh-copy-id k8s-2
ssh-copy-id k8s-3
3.1.7 添加 PATH 变量
vi /etc/profile
export PATH=$PATH:/cloud/k8s/etcd/bin/:/cloud/k8s/kubernetes/bin/
3.2 创建SSL证书
3.2.1 安装及配置CFSSL
wget https://pkg.cfssl.org/R1.2/cfssl_linux-amd64
wget https://pkg.cfssl.org/R1.2/cfssljson_linux-amd64
wget https://pkg.cfssl.org/R1.2/cfssl-certinfo_linux-amd64
chmod +x cfssl_linux-amd64 cfssljson_linux-amd64 cfssl-certinfo_linux-amd64
mv cfssl_linux-amd64 /usr/local/bin/cfssl
mv cfssljson_linux-amd64 /usr/local/bin/cfssljson
mv cfssl-certinfo_linux-amd64 /usr/bin/cfssl-certinfo
3.2.2 创建 ETCD 相关证书
以下操作均在/data/ssl_config/etcd/目录中
etcd证书ca配置
cd /data/ssl_config/etcd/
cat << EOF | tee ca-config.json
{
"signing": {
"default": {
"expiry": "87600h"
},
"profiles": {
"www": {
"expiry": "87600h",
"usages": [
"signing",
"key encipherment",
"server auth",
"client auth"
]
}
}
}
}
EOF
创建 ETCD CA 配置文件
cat << EOF | tee ca-csr.json
{
"CN": "etcd CA",
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing"
}
]
}
EOF
创建 ETCD Server 证书
cat << EOF | tee server-csr.json
{
"CN": "etcd",
"hosts": [
"k8s-3",
"k8s-2",
"k8s-1",
"192.168.123.211",
"192.168.123.212",
"192.168.123.213"
],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing"
}
]
}
EOF
生成 ETCD CA 证书和私钥
cd /data/ssl_config/etcd/
# 生成ca证书
cfssl gencert -initca ca-csr.json | cfssljson -bare ca -
# 生成server证书
cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=www server-csr.json | cfssljson -bare server
3.2.3 创建 KUBERNETES 相关证书
以下操作均在/data/ssl_config/kubernetes/目录中
kubernetes 证书ca配置
cd /data/ssl_config/kubernetes/
cat << EOF | tee ca-config.json
{
"signing": {
"default": {
"expiry": "87600h"
},
"profiles": {
"kubernetes": {
"expiry": "87600h",
"usages": [
"signing",
"key encipherment",
"server auth",
"client auth"
]
}
}
}
}
EOF
创建ca证书配置
cat << EOF | tee ca-csr.json
{
"CN": "kubernetes",
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing",
"O": "k8s",
"OU": "System"
}
]
}
EOF
生成API_SERVER证书
cat << EOF | tee server-csr.json
{
"CN": "kubernetes",
"hosts": [
"10.0.0.1",
"127.0.0.1",
"192.168.123.211",
"k8s-1",
"kubernetes",
"kubernetes.default",
"kubernetes.default.svc",
"kubernetes.default.svc.cluster",
"kubernetes.default.svc.cluster.local"
],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing",
"O": "k8s",
"OU": "System"
}
]
}
EOF
创建 Kubernetes Proxy 证书
cat << EOF | tee kube-proxy-csr.json
{
"CN": "system:kube-proxy",
"hosts": [],
"key": {
"algo": "rsa",
"size": 2048
},
"names": [
{
"C": "CN",
"L": "Beijing",
"ST": "Beijing",
"O": "k8s",
"OU": "System"
}
]
}
EOF
生成 **kubernetes ** CA 证书和私钥
# 生成ca证书
cfssl gencert -initca ca-csr.json | cfssljson -bare ca -
# 生成 api-server 证书
cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=kubernetes server-csr.json | cfssljson -bare server
# 生成 kube-proxy 证书
cfssl gencert -ca=ca.pem -ca-key=ca-key.pem -config=ca-config.json -profile=kubernetes kube-proxy-csr.json | cfssljson -bare kube-proxy
3.3 部署ETCD
3.3.1 配置软件包
cd /data/install/
tar -xvf etcd-v3.3.10-linux-amd64.tar.gz
cd etcd-v3.3.10-linux-amd64/
cp etcd etcdctl /cloud/k8s/etcd/bin/
3.3.2 编辑ETCD配置文件
vim /cloud/k8s/etcd/cfg/etcd
#[Member]
ETCD_NAME="etcd01"
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
ETCD_LISTEN_PEER_URLS="https://192.168.123.211:2380"
ETCD_LISTEN_CLIENT_URLS="https://192.168.123.211:2379"
#[Clustering]
ETCD_INITIAL_ADVERTISE_PEER_URLS="https://192.168.123.211:2380"
ETCD_ADVERTISE_CLIENT_URLS="https://192.168.123.211:2379"
ETCD_INITIAL_CLUSTER="etcd01=https://192.168.123.211:2380,etcd02=https://192.168.123.212:2380,etcd03=https://192.168.123.213:2380"
ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster"
ETCD_INITIAL_CLUSTER_STATE="new"
3.3.3 创建 ETCD的 SYSTEMD UNIT 文件
vim /usr/lib/systemd/system/etcd.service
[Unit]
Description=Etcd Server
After=network.target
After=network-online.target
Wants=network-online.target
[Service]
Type=notify
EnvironmentFile=/cloud/k8s/etcd/cfg/etcd
ExecStart=/cloud/k8s/etcd/bin/etcd \
--name=${ETCD_NAME} \
--data-dir=${ETCD_DATA_DIR} \
--listen-peer-urls=${ETCD_LISTEN_PEER_URLS} \
--listen-client-urls=${ETCD_LISTEN_CLIENT_URLS},http://127.0.0.1:2379 \
--advertise-client-urls=${ETCD_ADVERTISE_CLIENT_URLS} \
--initial-advertise-peer-urls=${ETCD_INITIAL_ADVERTISE_PEER_URLS} \
--initial-cluster=${ETCD_INITIAL_CLUSTER} \
--initial-cluster-token=${ETCD_INITIAL_CLUSTER_TOKEN} \
--initial-cluster-state=new \
--cert-file=/cloud/k8s/etcd/ssl/server.pem \
--key-file=/cloud/k8s/etcd/ssl/server-key.pem \
--peer-cert-file=/cloud/k8s/etcd/ssl/server.pem \
--peer-key-file=/cloud/k8s/etcd/ssl/server-key.pem \
--trusted-ca-file=/cloud/k8s/etcd/ssl/ca.pem \
--peer-trusted-ca-file=/cloud/k8s/etcd/ssl/ca.pem
Restart=on-failure
LimitNOFILE=65536
[Install]
WantedBy=multi-user.target
3.3.4 配置证书文件
cd /data/ssl_config/etcd/
cp ca*pem server*pem /cloud/k8s/etcd/ssl
3.3.5 配置文件拷贝到 节点1、节点2
cd /cloud/k8s/
scp -r etcd k8s-2:/cloud/k8s/
scp -r etcd k8s-3:/cloud/k8s/
scp /usr/lib/systemd/system/etcd.service k8s-2:/usr/lib/systemd/system/etcd.service
scp /usr/lib/systemd/system/etcd.service k8s-3:/usr/lib/systemd/system/etcd.service
修改另外两台机器配置文件
### k8s-2
cat /cloud/k8s/etcd/cfg/etcd
#[Member]
ETCD_NAME="etcd02"
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
ETCD_LISTEN_PEER_URLS="https://192.168.123.212:2380"
ETCD_LISTEN_CLIENT_URLS="https://192.168.123.212:2379"
#[Clustering]
ETCD_INITIAL_ADVERTISE_PEER_URLS="https://192.168.123.212:2380"
ETCD_ADVERTISE_CLIENT_URLS="https://192.168.123.212:2379"
ETCD_INITIAL_CLUSTER="etcd01=https://192.168.123.211:2380,etcd02=https://192.168.123.212:2380,etcd03=https://192.168.123.213:2380"
ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster"
ETCD_INITIAL_CLUSTER_STATE="new"
### k8s-3
cat /cloud/k8s/etcd/cfg/etcd
#[Member]
ETCD_NAME="etcd03"
ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
ETCD_LISTEN_PEER_URLS="https://192.168.123.213:2380"
ETCD_LISTEN_CLIENT_URLS="https://192.168.123.213:2379"
#[Clustering]
ETCD_INITIAL_ADVERTISE_PEER_URLS="https://192.168.123.213:2380"
ETCD_ADVERTISE_CLIENT_URLS="https://192.168.123.213:2379"
ETCD_INITIAL_CLUSTER="etcd01=https://192.168.123.211:2380,etcd02=https://192.168.123.212:2380,etcd03=https://192.168.123.213:2380"
ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster"
ETCD_INITIAL_CLUSTER_STATE="new"
另外两台机器配置完成后，启动etcd服务，三台都需启动。
3.3.6 启动ETCD服务
systemctl daemon-reload
systemctl enable etcd
systemctl start etcd
#启动ETCD集群同时启动二个节点，单节点是无法正常启动的。
3.3.7 检查服务是否正常
[root@k8s-1 /cloud/k8s/etcd/bin] master
# etcdctl --ca-file=/cloud/k8s/etcd/ssl/ca.pem --cert-file=/cloud/k8s/etcd/ssl/server.pem --key-file=/cloud/k8s/etcd/ssl/server-key.pem --endpoints="https://192.168.123.211:2379,https://192.168.123.212:2379,https://192.168.123.213:2379" cluster-health
member 4c6bfb873a73368c is healthy: got healthy result from https://192.168.123.213:2379
member 622f71dbd55b34ce is healthy: got healthy result from https://192.168.123.211:2379
member f14004aa5403b07d is healthy: got healthy result from https://192.168.123.212:2379
cluster is healthy
3.4 部署FLANNEL网络
3.4.1 向 ETCD 写入集群 POD 网段信息
cd /cloud/k8s/etcd/bin
etcdctl --ca-file=ca.pem --cert-file=server.pem --key-file=server-key.pem \
--endpoints="https://192.168.123.211:2379,https://192.168.123.212:2379,https://192.168.123.213:2379" \
set /coreos.com/network/config \
'{ "Network": "172.18.0.0/16", "Backend": {"Type": "vxlan"}}'
> 写入的 Pod 网段 ${CLUSTER_CIDR} 必须是 /16 段地址，必须与 kube-controller-manager 的 --cluster-cidr 参数值一致；
3.4.2 部署 FLANNEL
cd /data/install/
tar xf flannel-v0.11.0-linux-amd64.tar.gz
mv flanneld mk-docker-opts.sh /cloud/k8s/kubernetes/bin/
3.5.3 配置FLANNEL
vim /cloud/k8s/kubernetes/cfg/flanneld
FLANNEL_OPTIONS="--etcd-endpoints=https://192.168.123.211:2379,https://192.168.123.212:2379,https://192.168.123.213:2379 -etcd-cafile=/cloud/k8s/etcd/ssl/ca.pem -etcd-certfile=/cloud/k8s/etcd/ssl/server.pem -etcd-keyfile=/cloud/k8s/etcd/ssl/server-key.pem"
3.5.4 创建 FLANNELD 的 SYSTEMD UNIT 文件
vim /usr/lib/systemd/system/flanneld.service
[Unit]
Description=Flanneld overlay address etcd agent
After=network-online.target network.target
Before=docker.service
[Service]
Type=notify
EnvironmentFile=/cloud/k8s/kubernetes/cfg/flanneld
ExecStart=/cloud/k8s/kubernetes/bin/flanneld --ip-masq $FLANNEL_OPTIONS
ExecStartPost=/cloud/k8s/kubernetes/bin/mk-docker-opts.sh -k DOCKER_NETWORK_OPTIONS -d /run/flannel/subnet.env
Restart=on-failure
[Install]
WantedBy=multi-user.target
> mk-docker-opts.sh 脚本将分配给 flanneld 的 Pod 子网网段信息写入 /run/flannel/docker 文件，后续 docker 启动时 使用这个文件中的环境变量配置 docker0 网桥；
>
>
> flanneld 使用系统缺省路由所在的接口与其它节点通信，对于有多个网络接口（如内网和公网）的节点，可以用 -iface 参数指定通信接口，如上面的
> eth0 接口;
> flanneld 运行时需要 root 权限；
3.5.5 配置DOCKER启动指定子网段
vim /usr/lib/systemd/system/docker.service
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network-online.target firewalld.service
Wants=network-online.target
[Service]
Type=notify
EnvironmentFile=/run/flannel/subnet.env
ExecStart=/usr/bin/dockerd $DOCKER_NETWORK_OPTIONS
ExecReload=/bin/kill -s HUP $MAINPID
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
TimeoutStartSec=0
Delegate=yes
KillMode=process
Restart=on-failure
StartLimitBurst=3
StartLimitInterval=60s
[Install]
WantedBy=multi-user.target
3.5.6 将FLANNELD SYSTEMD UNIT 文件到所有节点
cd /cloud/k8s/
scp -r kubernetes k8s-2:/cloud/k8s/
scp -r kubernetes k8s-3:/cloud/k8s/
scp /cloud/k8s/kubernetes/cfg/flanneld k8s-2:/cloud/k8s/kubernetes/cfg/flanneld
scp /cloud/k8s/kubernetes/cfg/flanneld k8s-3:/cloud/k8s/kubernetes/cfg/flanneld
scp /usr/lib/systemd/system/docker.service k8s-2:/usr/lib/systemd/system/docker.service
scp /usr/lib/systemd/system/docker.service k8s-3:/usr/lib/systemd/system/docker.service
scp /usr/lib/systemd/system/flanneld.service k8s-2:/usr/lib/systemd/system/flanneld.service
scp /usr/lib/systemd/system/flanneld.service k8s-3:/usr/lib/systemd/system/flanneld.service
# 启动服务(每台节点都操作)
systemctl daemon-reload
systemctl start flanneld
systemctl enable flanneld
systemctl restart docker
3.5.7 验证FANNEL网络配置
[root@k8s-1 /data/install] master
# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 00:0c:29:33:de:53 brd ff:ff:ff:ff:ff:ff
inet 192.168.123.211/24 brd 192.168.123.255 scope global noprefixroute eth0
valid_lft forever preferred_lft forever
3: flannel.1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN group default
link/ether 1a:6f:5a:0b:c7:18 brd ff:ff:ff:ff:ff:ff
inet 172.18.30.0/32 scope global flannel.1
valid_lft forever preferred_lft forever
4: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
link/ether 02:42:5c:d0:df:e6 brd ff:ff:ff:ff:ff:ff
inet 172.18.30.1/24 brd 172.18.30.255 scope global docker0
valid_lft forever preferred_lft forever
3.5 部署 MASTER 节点
> kubernetes master 节点运行如下组件：
> kube-apiserver
> kube-scheduler
> kube-controller-manager
> kube-scheduler 和 kube-controller-manager 可以以集群模式运行，通过 leader
> 选举产生一个工作进程，其它进程处于阻塞模式。
3.5.1 配置 MASTER 节点文件
cd /data/install/
tar xf kubernetes-server-linux-amd64.tar.gz
cd kubernetes/server/bin/
cp kube-scheduler kube-apiserver kube-controller-manager kubectl /cloud/k8s/kubernetes/bin/
3.5.2 配置 KUBERNETES相关证书
cd /data/ssl_config/kubernetes/
cp *pem /cloud/k8s/kubernetes/ssl/
3.5.3 部署 KUBE-APISERVER 组件
创建 TLS Bootstrapping Token
# head -c 16 /dev/urandom | od -An -t x | tr -d ' '
449bbeb0ea7e50f321087a123a509a19
# vim /cloud/k8s/kubernetes/cfg/token.csv
449bbeb0ea7e50f321087a123a509a19,kubelet-bootstrap,10001,"system:kubelet-bootstrap"
创建apiserver配置文件
vim /cloud/k8s/kubernetes/cfg/kube-apiserver
KUBE_APISERVER_OPTS="--logtostderr=true \
--v=4 \
--etcd-servers=https://192.168.123.211:2379,https://192.168.123.212:2379,https://192.168.123.213:2379 \
--bind-address=192.168.123.211 \
--secure-port=6443 \
--advertise-address=192.168.123.211 \
--allow-privileged=true \
--service-cluster-ip-range=10.0.0.0/24 \
--enable-admission-plugins=NamespaceLifecycle,LimitRanger,SecurityContextDeny,ServiceAccount,ResourceQuota,NodeRestriction \
--authorization-mode=RBAC,Node \
--enable-bootstrap-token-auth \
--token-auth-file=/cloud/k8s/kubernetes/cfg/token.csv \
--service-node-port-range=30000-50000 \
--tls-cert-file=/cloud/k8s/kubernetes/ssl/server.pem \
--tls-private-key-file=/cloud/k8s/kubernetes/ssl/server-key.pem \
--client-ca-file=/cloud/k8s/kubernetes/ssl/ca.pem \
--service-account-key-file=/cloud/k8s/kubernetes/ssl/ca-key.pem \
--etcd-cafile=/cloud/k8s/etcd/ssl/ca.pem \
--etcd-certfile=/cloud/k8s/etcd/ssl/server.pem \
--etcd-keyfile=/cloud/k8s/etcd/ssl/server-key.pem"
创建 kube-apiserver systemd unit 文件
vim /usr/lib/systemd/system/kube-apiserver.service
[Unit]
Description=Kubernetes API Server
Documentation=https://github.com/kubernetes/kubernetes
[Service]
EnvironmentFile=/cloud/k8s/kubernetes/cfg/kube-apiserver
ExecStart=/cloud/k8s/kubernetes/bin/kube-apiserver $KUBE_APISERVER_OPTS
Restart=on-failure
[Install]
WantedBy=multi-user.target
启动服务
systemctl daemon-reload
systemctl enable kube-apiserver
systemctl restart kube-apiserver
查看apiserver是否运行
[root@k8s-1 /data/ssl_config/kubernetes] master
# ps -ef |grep kube-apiserver
root 5475 1 2 7月30 ? 01:57:41 /cloud/k8s/kubernetes/bin/kube-apiserver --logtostderr=true --v=4 --etcd-servers=https://192.168.123.211:2379,https://192.168.123.212:2379,https://192.168.123.213:2379 --bind-address=192.168.123.211 --secure-port=6443 --advertise-address=192.168.123.211 --allow-privileged=true --service-cluster-ip-range=10.0.0.0/24 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,SecurityContextDeny,ServiceAccount,ResourceQuota,NodeRestriction --authorization-mode=RBAC,Node --enable-bootstrap-token-auth --token-auth-file=/cloud/k8s/kubernetes/cfg/token.csv --service-node-port-range=30000-50000 --tls-cert-file=/cloud/k8s/kubernetes/ssl/server.pem --tls-private-key-file=/cloud/k8s/kubernetes/ssl/server-key.pem --client-ca-file=/cloud/k8s/kubernetes/ssl/ca.pem --service-account-key-file=/cloud/k8s/kubernetes/ssl/ca-key.pem --etcd-cafile=/cloud/k8s/etcd/ssl/ca.pem --etcd-certfile=/cloud/k8s/etcd/ssl/server.pem --etcd-keyfile=/cloud/k8s/etcd/ssl/server-key.pem
root 6886 2930 0 19:49 pts/0 00:00:00 grep --color=auto kube-apiserver
3.5.4 部署KUBE-SCHEDULER
创建kube-scheduler配置文件
vim /cloud/k8s/kubernetes/cfg/kube-scheduler
KUBE_SCHEDULER_OPTS="--logtostderr=true --v=4 --master=127.0.0.1:8080 --leader-elect"
> --address：在 127.0.0.1:10251 端口接收 http /metrics 请求；kube-scheduler 目前还不支持接收 https 请求；
>
>
> –kubeconfig：指定 kubeconfig 文件路径，kube-scheduler 使用它连接和验证 kube-apiserver；
> –leader-elect=true：集群运行模式，启用选举功能；被选为 leader 的节点负责处理工作，其它节点为阻塞状态；
创建kube-scheduler systemd unit 文件
vim /usr/lib/systemd/system/kube-scheduler.service
[Unit]
Description=Kubernetes Scheduler
Documentation=https://github.com/kubernetes/kubernetes
[Service]
EnvironmentFile=/cloud/k8s/kubernetes/cfg/kube-scheduler
ExecStart=/cloud/k8s/kubernetes/bin/kube-scheduler $KUBE_SCHEDULER_OPTS
Restart=on-failure
[Install]
WantedBy=multi-user.target
启动kube-scheduler服务
systemctl daemon-reload
systemctl enable kube-scheduler.service
systemctl restart kube-scheduler.service
查看kube-scheduler是否运行
[root@k8s-1 /data/ssl_config/kubernetes] master
# ps -ef |grep kube-scheduler
root 7269 2930 0 19:54 pts/0 00:00:00 grep --color=auto kube-scheduler
root 13970 1 0 8月02 ? 00:01:21 /cloud/k8s/kubernetes/bin/kube-scheduler --logtostderr=true --v=4 --master=127.0.0.1:8080 --leader-elect
[root@k8s-1 /data/ssl_config/kubernetes] master
# systemctl status kube-scheduler
● kube-scheduler.service - Kubernetes Scheduler
Loaded: loaded (/usr/lib/systemd/system/kube-scheduler.service; enabled; vendor preset: disabled)
Active: active (running) since 五 2019-08-02 18:33:11 CST; 1 day 1h ago
Docs: https://github.com/kubernetes/kubernetes
Main PID: 13970 (kube-scheduler)
Tasks: 10
Memory: 19.1M
CGroup: /system.slice/kube-scheduler.service
└─13970 /cloud/k8s/kubernetes/bin/kube-scheduler --logtostderr=tru...
8月 03 19:46:52 k8s-1 kube-scheduler[13970]: I0803 19:46:52.580662 13970 ...d
8月 03 19:47:03 k8s-1 kube-scheduler[13970]: I0803 19:47:03.578985 13970 ...d
8月 03 19:47:03 k8s-1 kube-scheduler[13970]: I0803 19:47:03.583437 13970 ...d
8月 03 19:48:31 k8s-1 kube-scheduler[13970]: I0803 19:48:31.637472 13970 ...d
8月 03 19:48:48 k8s-1 kube-scheduler[13970]: I0803 19:48:48.617124 13970 ...d
8月 03 19:50:00 k8s-1 kube-scheduler[13970]: I0803 19:50:00.589103 13970 ...d
8月 03 19:50:18 k8s-1 kube-scheduler[13970]: I0803 19:50:18.616574 13970 ...d
8月 03 19:52:15 k8s-1 kube-scheduler[13970]: I0803 19:52:15.629976 13970 ...d
8月 03 19:52:45 k8s-1 kube-scheduler[13970]: I0803 19:52:45.580103 13970 ...d
8月 03 19:53:56 k8s-1 kube-scheduler[13970]: I0803 19:53:56.601687 13970 ...d
Hint: Some lines were ellipsized, use -l to show in full.
3.5.5 部署KUBE-CONTROLLER-MANAGER
创建kube-controller-manager配置文件
vim /cloud/k8s/kubernetes/cfg/kube-controller-manager
KUBE_CONTROLLER_MANAGER_OPTS="--logtostderr=true \
--v=4 \
--master=127.0.0.1:8080 \
--leader-elect=true \
--address=127.0.0.1 \
--service-cluster-ip-range=10.0.0.0/24 \
--cluster-name=kubernetes \
--cluster-signing-cert-file=/cloud/k8s/kubernetes/ssl/ca.pem \
--cluster-signing-key-file=/cloud/k8s/kubernetes/ssl/ca-key.pem \
--root-ca-file=/cloud/k8s/kubernetes/ssl/ca.pem \
--service-account-private-key-file=/cloud/k8s/kubernetes/ssl/ca-key.pem"
创建kube-controller-manager systemd unit 文件
vim /usr/lib/systemd/system/kube-controller-manager.service
[Unit]
Description=Kubernetes Controller Manager
Documentation=https://github.com/kubernetes/kubernetes
[Service]
EnvironmentFile=/cloud/k8s/kubernetes/cfg/kube-controller-manager
ExecStart=/cloud/k8s/kubernetes/bin/kube-controller-manager $KUBE_CONTROLLER_MANAGER_OPTS
Restart=on-failure
[Install]
WantedBy=multi-user.target
启动服务
systemctl daemon-reload
systemctl enable kube-controller-manager
systemctl restart kube-controller-manager
查看kube-controller-manager是否运行
[root@k8s-1 /data/ssl_config/kubernetes] master
# ps -ef |grep kube-controller-manager
root 7759 2930 0 19:59 pts/0 00:00:00 grep --color=auto kube-controller-manager
root 13972 1 0 8月02 ? 00:10:56 /cloud/k8s/kubernetes/bin/kube-controller-manager --logtostderr=true --v=4 --master=127.0.0.1:8080 --leader-elect=true --address=127.0.0.1 --service-cluster-ip-range=10.0.0.0/24 --cluster-name=kubernetes --cluster-signing-cert-file=/cloud/k8s/kubernetes/ssl/ca.pem --cluster-signing-key-file=/cloud/k8s/kubernetes/ssl/ca-key.pem --root-ca-file=/cloud/k8s/kubernetes/ssl/ca.pem --service-account-private-key-file=/cloud/k8s/kubernetes/ssl/ca-key.pem
[root@k8s-1 /data/ssl_config/kubernetes] master
# systemctl status kube-controller-manager
● kube-controller-manager.service - Kubernetes Controller Manager
Loaded: loaded (/usr/lib/systemd/system/kube-controller-manager.service; enabled; vendor preset: disabled)
Active: active (running) since 五 2019-08-02 18:33:13 CST; 1 day 1h ago
Docs: https://github.com/kubernetes/kubernetes
Main PID: 13972 (kube-controller)
Tasks: 10
Memory: 51.9M
CGroup: /system.slice/kube-controller-manager.service
└─13972 /cloud/k8s/kubernetes/bin/kube-controller-manager --logtos...
8月 03 19:59:48 k8s-1 kube-controller-manager[13972]: I0803 19:59:48.522342 ...
8月 03 19:59:48 k8s-1 kube-controller-manager[13972]: I0803 19:59:48.526381 ...
8月 03 19:59:50 k8s-1 kube-controller-manager[13972]: I0803 19:59:50.211112 ...
8月 03 19:59:50 k8s-1 kube-controller-manager[13972]: I0803 19:59:50.455555 ...
8月 03 19:59:50 k8s-1 kube-controller-manager[13972]: I0803 19:59:50.738397 ...
8月 03 19:59:50 k8s-1 kube-controller-manager[13972]: I0803 19:59:50.767332 ...
8月 03 19:59:51 k8s-1 kube-controller-manager[13972]: I0803 19:59:51.502835 ...
8月 03 19:59:53 k8s-1 kube-controller-manager[13972]: I0803 19:59:53.567923 ...
8月 03 19:59:53 k8s-1 kube-controller-manager[13972]: I0803 19:59:53.567955 ...
8月 03 19:59:54 k8s-1 kube-controller-manager[13972]: I0803 19:59:54.321341 ...
Hint: Some lines were ellipsized, use -l to show in full.
3.5.6 查看MASTER集群状态
[root@k8s-1 /root] master
# kubectl get cs,nodes
NAME STATUS MESSAGE ERROR
componentstatus/controller-manager Healthy ok
componentstatus/scheduler Healthy ok
componentstatus/etcd-2 Healthy {"health":"true"}
componentstatus/etcd-1 Healthy {"health":"true"}
componentstatus/etcd-0 Healthy {"health":"true"}
3.6 部署NODE 节点
> kubernetes work 节点运行如下组件：
> docker
> kubelet
> kube-proxy
3.6.1 部署 KUBELET 组件
> kublet 运行在每个 worker 节点上，接收 kube-apiserver 发送的请求，管理 Pod 容器，执行交互式命令，如exec、run、logs 等;
>
>
> kublet 启动时自动向 kube-apiserver 注册节点信息，内置的 cadvisor 统计和监控节点的资源使用情况;
> 为确保安全，本文档只开启接收 https 请求的安全端口，对请求进行认证和授权，拒绝未授权的访问(如apiserver、heapster)。
配置node节点
cd /data/install/kubernetes/server/bin/
scp kubelet kube-proxy k8s-2:/cloud/k8s/kubernetes/bin/
scp kubelet kube-proxy k8s-3:/cloud/k8s/kubernetes/bin/
创建 kubelet bootstrap.kubeconfig 文件
cd /data/ssl_config/kubernetes/
vim environment.sh
# 创建kubelet bootstrapping kubeconfig
BOOTSTRAP_TOKEN=449bbeb0ea7e50f321087a123a509a19
KUBE_APISERVER="https://192.168.123.211:6443"
# 设置集群参数
kubectl config set-cluster kubernetes \
--certificate-authority=./ca.pem \
--embed-certs=true \
--server=${KUBE_APISERVER} \
--kubeconfig=bootstrap.kubeconfig
# 设置客户端认证参数
kubectl config set-credentials kubelet-bootstrap \
--token=${BOOTSTRAP_TOKEN} \
--kubeconfig=bootstrap.kubeconfig
# 设置上下文参数
kubectl config set-context default \
--cluster=kubernetes \
--user=kubelet-bootstrap \
--kubeconfig=bootstrap.kubeconfig
# 设置默认上下文
kubectl config use-context default --kubeconfig=bootstrap.kubeconfig
> 通过 bash environment.sh获取 bootstrap.kubeconfig 配置文件。
创建 kubelet.kubeconfig 文件
vim envkubelet.kubeconfig.sh
# 创建kubelet bootstrapping kubeconfig
BOOTSTRAP_TOKEN=449bbeb0ea7e50f321087a123a509a19
KUBE_APISERVER="https://192.168.123.211:6443"
# 设置集群参数
kubectl config set-cluster kubernetes \
--certificate-authority=./ca.pem \
--embed-certs=true \
--server=${KUBE_APISERVER} \
--kubeconfig=kubelet.kubeconfig
# 设置客户端认证参数
kubectl config set-credentials kubelet \
--token=${BOOTSTRAP_TOKEN} \
--kubeconfig=kubelet.kubeconfig
# 设置上下文参数
kubectl config set-context default \
--cluster=kubernetes \
--user=kubelet \
--kubeconfig=kubelet.kubeconfig
# 设置默认上下文
kubectl config use-context default --kubeconfig=kubelet.kubeconfig
创建kube-proxy kubeconfig文件
vim env_proxy.sh
# 创建kube-proxy kubeconfig文件
BOOTSTRAP_TOKEN=449bbeb0ea7e50f321087a123a509a19
KUBE_APISERVER="https://192.168.123.211:6443"
kubectl config set-cluster kubernetes \
--certificate-authority=./ca.pem \
--embed-certs=true \
--server=${KUBE_APISERVER} \
--kubeconfig=kube-proxy.kubeconfig
kubectl config set-credentials kube-proxy \
--client-certificate=./kube-proxy.pem \
--client-key=./kube-proxy-key.pem \
--embed-certs=true \
--kubeconfig=kube-proxy.kubeconfig
kubectl config set-context default \
--cluster=kubernetes \
--user=kube-proxy \
--kubeconfig=kube-proxy.kubeconfig
kubectl config use-context default --kubeconfig=kube-proxy.kubeconfig
将bootstrap kubeconfig kube-proxy.kubeconfig 文件拷贝到所有 nodes节点
scp -rp bootstrap.kubeconfig kube-proxy.kubeconfig k8s-2:/cloud/k8s/kubernetes/cfg/
scp -rp bootstrap.kubeconfig kube-proxy.kubeconfig k8s-3:/cloud/k8s/kubernetes/cfg/
3.6.2 创建KUBELET 参数配置文件拷贝到所有 NODES节点
创建 kubelet 参数配置模板文件
[root@k8s-2 /root] node
# cat /cloud/k8s/kubernetes/cfg/kubelet.config
kind: KubeletConfiguration
apiVersion: kubelet.config.k8s.io/v1beta1
address: 192.168.123.212
port: 10250
readOnlyPort: 10255
cgroupDriver: cgroupfs
clusterDomain: cluster.local.
failSwapOn: false
authentication:
anonymous:
enabled: true
创建kubelet配置文件
vim /cloud/k8s/kubernetes/cfg/kubelet
KUBELET_OPTS="--logtostderr=true \
--v=4 \
--hostname-override=k8s-2 \
--kubeconfig=/cloud/k8s/kubernetes/cfg/kubelet.kubeconfig \
--bootstrap-kubeconfig=/cloud/k8s/kubernetes/cfg/bootstrap.kubeconfig \
--config=/cloud/k8s/kubernetes/cfg/kubelet.config \
--cert-dir=/cloud/k8s/kubernetes/ssl \
--pod-infra-container-image=registry.cn-hangzhou.aliyuncs.com/google-containers/pause-amd64:3.0"
创建kubelet systemd unit 文件
vim /usr/lib/systemd/system/kubelet.service
[Unit]
Description=Kubernetes Kubelet
After=docker.service
Requires=docker.service
[Service]
EnvironmentFile=/cloud/k8s/kubernetes/cfg/kubelet
ExecStart=/cloud/k8s/kubernetes/bin/kubelet $KUBELET_OPTS
Restart=on-failure
KillMode=process
[Install]
WantedBy=multi-user.target
将kubelet-bootstrap用户绑定到系统集群角色
kubectl create clusterrolebinding kubelet-bootstrap \
--clusterrole=system:node-bootstrapper \
--user=kubelet-bootstrap
3.6.3 启动KUBELET服务
systemctl daemon-reload
systemctl enable kubelet
systemctl restart kubelet
3.6.4 APPROVE KUBELET CSR 请求
kubectl get csr
kubectl certificate approve $NAME
kubectl get csr
csr 状态变为 Approved,Issued 即可
> * Requesting User：请求 CSR 的用户，kube-apiserver 对它进行认证和授权；
> * Subject：请求签名的证书信息；
> * 证书的 CN 是 system:node:kube-node2， Organization 是 system:nodes，kube-apiserver
> 的 Node 授权模式会授予该证书的相关权限；
3.6.5 查看集群状态
[root@k8s-1 /root] master
# kubectl get nodes,cs
NAME STATUS ROLES AGE VERSION
node/k8s-2 Ready node 3d22h v1.15.1
node/k8s-3 Ready node 3d22h v1.15.1
NAME STATUS MESSAGE ERROR
componentstatus/scheduler Healthy ok
componentstatus/controller-manager Healthy ok
componentstatus/etcd-0 Healthy {"health":"true"}
componentstatus/etcd-2 Healthy {"health":"true"}
componentstatus/etcd-1 Healthy {"health":"true"}
3.7 部署 NODE KUBE-PROXY 组件
> kube-proxy 运行在所有 node节点上，它监听 apiserver 中 service 和 Endpoint
> 的变化情况，创建路由规则来进行服务负载均衡。
3.7.1 创建KUBE-PROXY配置文件
vim /cloud/k8s/kubernetes/cfg/kube-proxy
KUBE_PROXY_OPTS="--logtostderr=true \
--v=4 \
--hostname-override=k8s-2 \
--cluster-cidr=10.0.0.0/24 \
--kubeconfig=/cloud/k8s/kubernetes/cfg/kube-proxy.kubeconfig"
3.7.2 创建KUBE-PROXY SYSTEMD UNIT 文件
vim /usr/lib/systemd/system/kube-proxy.service
[Unit]
Description=Kubernetes Proxy
After=network.target
[Service]
EnvironmentFile=/cloud/k8s/kubernetes/cfg/kube-proxy
ExecStart=/cloud/k8s/kubernetes/bin/kube-proxy $KUBE_PROXY_OPTS
Restart=on-failure
[Install]
WantedBy=multi-user.target
3.7.3 启动KUBE-PROXY服务
systemctl daemon-reload
systemctl enable kube-proxy
systemctl restart kube-proxy
3.7.4 检查服务运行状态
[root@k8s-2 /root] node
# systemctl status kube-proxy
● kube-proxy.service - Kubernetes Proxy
Loaded: loaded (/usr/lib/systemd/system/kube-proxy.service; enabled; vendor preset: disabled)
Active: active (running) since 二 2019-07-30 22:30:04 CST; 3 days ago
Main PID: 5764 (kube-proxy)
Tasks: 0
Memory: 11.8M
CGroup: /system.slice/kube-proxy.service
‣ 5764 /cloud/k8s/kubernetes/bin/kube-proxy --logtostderr=true --v...
8月 03 20:51:33 k8s-2 kube-proxy[5764]: I0803 20:51:33.736946 5764 iptab...]
8月 03 20:51:33 k8s-2 kube-proxy[5764]: I0803 20:51:33.740738 5764 healt..."
8月 03 20:51:33 k8s-2 kube-proxy[5764]: I0803 20:51:33.740762 5764 proxi...s
8月 03 20:51:33 k8s-2 kube-proxy[5764]: I0803 20:51:33.740780 5764 bound...s
8月 03 20:51:34 k8s-2 kube-proxy[5764]: I0803 20:51:34.018700 5764 confi...e
8月 03 20:51:34 k8s-2 kube-proxy[5764]: I0803 20:51:34.028396 5764 confi...e
8月 03 20:51:36 k8s-2 kube-proxy[5764]: I0803 20:51:36.035812 5764 confi...e
8月 03 20:51:36 k8s-2 kube-proxy[5764]: I0803 20:51:36.046563 5764 confi...e
8月 03 20:51:38 k8s-2 kube-proxy[5764]: I0803 20:51:38.045395 5764 confi...e
8月 03 20:51:38 k8s-2 kube-proxy[5764]: I0803 20:51:38.061197 5764 confi...e
Hint: Some lines were ellipsized, use -l to show in full.
至此 kubernetes 1.15 版本简单部署完成~
[未完待续]
* 1. 架构篇
* 1.1 kubernetes 架构说明
* 1.2 Flannel网络架构图
* 1.3 Kubernetes工作流程
* 2. 环境说明
* 2.1 部署节点说明
* 2.2 操作系统环境
* 2.3 软件包版本
* 3. Kubernetes 安装及配置
* 3.1 初始化环境
* 3.1.1 设置关闭防火墙及SELINUX
* 3.1.2 关闭swap
* 3.1.3 设置Docker所需参数
* 3.1.4 安装 Docker
* 3.1.5 创建相关目录
* 3.1.6 SSH 互信配置
* 3.1.7 添加 PATH 变量
* 3.2 创建ssl证书
* 3.2.1 安装及配置CFSSL
* 3.2.2 创建 ETCD 相关证书
* 3.2.3 创建 Kubernetes 相关证书
* 3.3 部署etcd
* 3.3.1 配置软件包
* 3.3.2 编辑etcd配置文件
* 3.3.3 创建 etcd的 systemd unit 文件
* 3.3.4 配置证书文件
* 3.3.5 配置文件拷贝到 节点1、节点2
* 3.3.6 启动ETCD服务
* 3.3.7 检查服务是否正常
* 3.4 部署Flannel网络
* 3.4.1 向 etcd 写入集群 Pod 网段信息
* 3.4.2 部署 flannel
* 3.5.3 配置flannel
* 3.5.4 创建 flanneld 的 systemd unit 文件
* 3.5.5 配置Docker启动指定子网段
* 3.5.6 将flanneld systemd unit 文件到所有节点
* 3.5.7 验证fannel网络配置
* 3.5 部署 master 节点
* 3.5.1 配置 master 节点文件
* 3.5.2 配置 kubernetes相关证书
* 3.5.3 部署 kube-apiserver 组件
* 3.5.4 部署kube-scheduler
* 3.5.5 部署kube-controller-manager
* 3.5.6 查看master集群状态
* 3.6 部署node 节点
* 3.6.1 部署 kubelet 组件
* 3.6.2 创建kubelet 参数配置文件拷贝到所有 nodes节点
* 3.6.3 启动kubelet服务
* 3.6.4 approve kubelet CSR 请求
* 3.6.5 查看集群状态
* 3.7 部署 node kube-proxy 组件
* 3.7.1 创建kube-proxy配置文件
* 3.7.2 创建kube-proxy systemd unit 文件
* 3.7.3 启动kube-proxy服务
* 3.7.4 检查服务运行状态
* 原文作者：惨绿少年
* 原文链接：https://clsn.io/clsn/lx1517.html
* 版权声明：本作品采用知识共享署名-非商业性使用-禁止演绎 4.0
国际许可协议进行许可，非商业转载请注明出处（作者，原文链接），商业转载请联系作者获得授权。
没有标签
© 2023 CLSN - 惨绿少年博客 By 惨绿少年
Powered byHugo
Design by飞雪无情
ThemeMaupassant
最近文章
* Kubernetes V1.15 二进制部署集群
* CentOS6.x使用ip netns（网络namespace）解决方案
* Centos内核版本升级
* ZABBIX 4.0 LTS 部署
* SSH + Google Authenticator 安全加固
* CLSN Whois API
* Hadoop+HBase 集群搭建
* 自动化运维之PSSH
* KVM之CPU虚拟化
* GoAccess日志分析工具
分类
* Linux运维 (137)
* MySQL (11)
* NoSQL (8)
* OpenStack (3)
* Shell编程 (16)
* Web应用 (14)
* 云计算 (18)
* 存储 (13)
* 安全 (26)
* 敏捷开发 (13)
* 数据库 (20)
* 玩转Linux (68)
* 监控服务 (11)
* 网络技术 (14)
* 自动化 (23)
* 虚拟化 (10)
* 运维基本功 (118)
标签
友情链接
* 惨绿少年(博客园)
* container-monitor
其它
* 文章 RSS
WELCOME TO CLSN.IO
CLSN.IO ASKS FOR YOUR CONSENT TO USE YOUR PERSONAL DATA TO:
* perm_identity
Personalised advertising and content, advertising and content measurement,
audience research and services development
* devices
Store and/or access information on a device
expand_moreremove
Learn more
*
How can I change my choice?
*
What if I don't consent?
*
How does legitimate interest work?
*
Do I have to consent to everything?
Your personal data will be processed and information from your device (cookies,
unique identifiers, and other device data) may be stored by, accessed by and
shared with 135 TCF vendor(s) and 67 ad partner(s), or used specifically by this
site or app.
Some vendors may process your personal data on the basis of legitimate interest,
which you can object to by managing your options below. Look for a link at the
bottom of this page or in our privacy policy where you can withdraw consent.
Consent
Do not consent
Manage options
arrow_back
Data preferences
MANAGE YOUR DATA
You can choose how your personal data is used. Vendors want your permission to
do the following:
TCF vendors
help_outline
STORE AND/OR ACCESS INFORMATION ON A DEVICE
Cookies, device or similar online identifiers (e.g. login-based identifiers,
randomly assigned identifiers, network based identifiers) together with other
information (e.g. browser type and information, language, screen size, supported
technologies etc.) can be stored or read on your device to recognise it each
time it connects to an app or to a website, for one or several of the purposes
presented here.
View details
Consent (119 vendors)
USE LIMITED DATA TO SELECT ADVERTISING
Advertising presented to you on this service can be based on limited data, such
as the website or app you are using, your non-precise location, your device type
or which content you are (or have been) interacting with (for example, to limit
the number of times an ad is presented to you).
View details
Consent (70 vendors)Legitimate interest (32 vendors)help_outline
CREATE PROFILES FOR PERSONALISED ADVERTISING
Information about your activity on this service (such as forms you submit,
content you look at) can be stored and combined with other information about you
(for example, information from your previous activity on this service and other
websites or apps) or similar users. This is then used to build or improve a
profile about you (that might include possible interests and personal aspects).
Your profile can be used (also later) to present advertising that appears more
relevant based on your possible interests by this and other entities.
View details
Consent (98 vendors)
USE PROFILES TO SELECT PERSONALISED ADVERTISING
Advertising presented to you on this service can be based on your advertising
profiles, which can reflect your activity on this service or other websites or
apps (like the forms you submit, content you look at), possible interests and
personal aspects.
View details
Consent (92 vendors)
CREATE PROFILES TO PERSONALISE CONTENT
Information about your activity on this service (for instance, forms you submit,
non-advertising content you look at) can be stored and combined with other
information about you (such as your previous activity on this service or other
websites or apps) or similar users. This is then used to build or improve a
profile about you (which might for example include possible interests and
personal aspects). Your profile can be used (also later) to present content that
appears more relevant based on your possible interests, such as by adapting the
order in which content is shown to you, so that it is even easier for you to
find content that matches your interests.
View details
Consent (32 vendors)
USE PROFILES TO SELECT PERSONALISED CONTENT
Content presented to you on this service can be based on your content
personalisation profiles, which can reflect your activity on this or other
services (for instance, the forms you submit, content you look at), possible
interests and personal aspects, such as by adapting the order in which content
is shown to you, so that it is even easier for you to find (non-advertising)
content that matches your interests.
View details
Consent (26 vendors)
MEASURE ADVERTISING PERFORMANCE
Information regarding which advertising is presented to you and how you interact
with it can be used to determine how well an advert has worked for you or other
users and whether the goals of the advertising were reached. For instance,
whether you saw an ad, whether you clicked on it, whether it led you to buy a
product or visit a website, etc. This is very helpful to understand the
relevance of advertising campaigns.
View details
Consent (77 vendors)Legitimate interest (46 vendors)help_outline
MEASURE CONTENT PERFORMANCE
Information regarding which content is presented to you and how you interact
with it can be used to determine whether the (non-advertising) content e.g.
reached its intended audience and matched your interests. For instance, whether
you read an article, watch a video, listen to a podcast or look at a product
description, how long you spent on this service and the web pages you visit etc.
This is very helpful to understand the relevance of (non-advertising) content
that is shown to you.
View details
Consent (31 vendors)Legitimate interest (14 vendors)help_outline
UNDERSTAND AUDIENCES THROUGH STATISTICS OR COMBINATIONS OF DATA FROM DIFFERENT
SOURCES
Reports can be generated based on the combination of data sets (like user
profiles, statistics, market research, analytics data) regarding your
interactions and those of other users with advertising or (non-advertising)
content to identify common characteristics (for instance, to determine which
target audiences are more receptive to an ad campaign or to certain contents).
View details
Consent (57 vendors)Legitimate interest (20 vendors)help_outline
DEVELOP AND IMPROVE SERVICES
Information about your activity on this service, such as your interaction with
ads or content, can be very helpful to improve products and services and to
build new products and services based on user interactions, the type of
audience, etc. This specific purpose does not include the development or
improvement of user profiles and identifiers.
View details
Consent (65 vendors)Legitimate interest (37 vendors)help_outline
USE LIMITED DATA TO SELECT CONTENT
Content presented to you on this service can be based on limited data, such as
the website or app you are using, your non-precise location, your device type,
or which content you are (or have been) interacting with (for example, to limit
the number of times a video or an article is presented to you).
View details
Consent (9 vendors)Legitimate interest (2 vendors)help_outline
ENSURE SECURITY, PREVENT AND DETECT FRAUD, AND FIX ERRORS
help_outline
Your data can be used to monitor for and prevent unusual and possibly fraudulent
activity (for example, regarding advertising, ad clicks by bots), and ensure
systems and processes work properly and securely. It can also be used to correct
any problems you, the publisher or the advertiser may encounter in the delivery
of content and ads and in your interaction with them.
View details
DELIVER AND PRESENT ADVERTISING AND CONTENT
help_outline
Certain information (like an IP address or device capabilities) is used to
ensure the technical compatibility of the content or advertising, and to
facilitate the transmission of the content or ad to your device.
View details
MATCH AND COMBINE DATA FROM OTHER DATA SOURCES
help_outline
Information about your activity on this service may be matched and combined with
other information relating to you and originating from various sources (for
instance your activity on a separate online service, your use of a loyalty card
in-store, or your answers to a survey), in support of the purposes explained in
this notice.
View details
LINK DIFFERENT DEVICES
help_outline
In support of the purposes explained in this notice, your device might be
considered as likely linked to other devices that belong to you or your
household (for instance because you are logged in to the same service on both
your phone and your computer, or because you may use the same Internet
connection on both devices).
View details
IDENTIFY DEVICES BASED ON INFORMATION TRANSMITTED AUTOMATICALLY
help_outline
Your device might be distinguished from other devices based on information it
automatically sends when accessing the Internet (for instance, the IP address of
your Internet connection or the type of browser you are using) in support of the
purposes exposed in this notice.
View details
USE PRECISE GEOLOCATION DATA
With your acceptance, your precise location (within a radius of less than 500
metres) may be used in support of the purposes explained in this notice.
View details
Consent
Vendor preferences
Accept all
Confirm choices
arrow_back
Vendor preferences
CONFIRM OUR VENDORS
Vendors can use your data to provide services. Declining a vendor can stop them
from using the data you shared.
TCF vendors
help_outline
EXPONENTIAL INTERACTIVE, INC D/B/A VDX.TV
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device identifiers,
Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ROQ.AD GMBH
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, Authentication-derived identifiers, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ADMAXIM LIMITED
Cookie duration: 30 (days).
Data collected and processed: Browsing and interaction data, Probabilistic
identifiers, IP addresses
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
INDEX EXCHANGE INC.
Cookie duration: 395 (days).
Data collected and processed: Privacy choices, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
QUANTCAST
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
BEESWAXIO CORPORATION
Cookie duration: 395 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Precise
location data, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
SOVRN, INC.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device characteristics, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
ADIKTEEV
Doesn't use cookies.
Data collected and processed: Users’ profiles, Probabilistic identifiers,
Authentication-derived identifiers, IP addresses, Device characteristics, Device
identifiers, Non-precise location data
more
Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
RTB HOUSE S.A.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device characteristics, Device identifiers,
Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
THE UK TRADE DESK LTD
Cookie duration: 3629 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ADMETRICS GMBH
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics
more
View details | Privacy policylaunch
Consent
AMOBEE INC.
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
EPSILON
Cookie duration: 184 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
YAHOO EMEA LIMITED
Cookie duration: 397 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ADVENTORI SAS
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data,
Authentication-derived identifiers, IP addresses, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
TRIPLELIFT, INC.
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
XANDR, INC.
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
NEORY GMBH
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session.
View details | Privacy policylaunch
Consent
UNRULY GROUP LLC
Cookie duration: 365 (days).
Data collected and processed: Users’ profiles, Privacy choices, Probabilistic
identifiers, IP addresses, Device characteristics, Device identifiers,
Non-precise location data
more
Cookie duration resets each session.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
NEURAL.ONE
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Non-precise
location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
ADITION (VIRTUAL MINDS GMBH)
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ACTIVE AGENT (VIRTUAL MINDS GMBH)
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
TABOOLA EUROPE LIMITED
Cookie duration: 366 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
EQUATIV
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
ADFORM A/S
Cookie duration: 1 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
MAGNITE, INC.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Precise
location data, Device identifiers, Non-precise location data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
RATEGAIN ADARA INC
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
View details | Storage details | Privacy policylaunch
Consent
SIFT MEDIA, INC
Doesn't use cookies.
Data collected and processed: IP addresses, Device characteristics, Precise
location data, Device identifiers, Non-precise location data
more
View details | Privacy policylaunch
Consent
RAKUTEN MARKETING LLC
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
LUMEN RESEARCH LIMITED
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, IP addresses,
Device characteristics, Non-precise location data
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
AMAZON AD SERVER
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
OPENX
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
YIELDLAB (VIRTUAL MINDS GMBH)
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device characteristics, Precise location data,
Device identifiers, Non-precise location data, User-provided data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ROKU ADVERTISING SERVICES
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
SIMPLIFI HOLDINGS INC
Cookie duration: 366 (days).
Data collected and processed: IP addresses, Precise location data, Device
identifiers
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
PUBMATIC, INC
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
COMSCORE B.V.
Cookie duration: 720 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, Authentication-derived identifiers, IP addresses,
Device characteristics, Device identifiers, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
FLASHTALKING
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data
more
View details | Privacy policylaunch
Consent
PULSEPOINT, INC.
Cookie duration: 365 (days).
Data collected and processed: IP addresses, Device characteristics, Device
identifiers
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
SMAATO, INC.
Cookie duration: 21 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
SEMASIO GMBH
Cookie duration: 366 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device identifiers
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
CRIMTAN HOLDINGS LIMITED
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
GENIUS SPORTS UK LIMITED
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
CRITEO SA
Cookie duration: 390 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ADLOOX SA
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Probabilistic
identifiers, IP addresses, Device characteristics, Device identifiers,
Non-precise location data
more
Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
BLIS GLOBAL LIMITED
Cookie duration: 400 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
LOTAME SOLUTIONS, INC
Cookie duration: 274 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
LIVERAMP
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Authentication-derived identifiers, IP addresses, Device characteristics, Device
identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
GROUPM UK LIMITED
Cookie duration: 395 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, Authentication-derived identifiers, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
LOOPME LIMITED
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
DYNATA LLC
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ASK LOCALA
Doesn't use cookies.
Data collected and processed: Privacy choices, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
NEAR INTELLIGENCE
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
DOUBLEVERIFY INC.
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Non-precise
location data
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
BIDSWITCH GMBH
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, Authentication-derived identifiers, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
IPONWEB GMBH
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Authentication-derived identifiers, IP addresses, Device characteristics, Device
identifiers, Non-precise location data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
NEXTROLL, INC.
Cookie duration: 183 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device characteristics, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session.
View details | Privacy policylaunch
Consent
TEADS FRANCE SAS
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
STRÖER SSP GMBH (SSP)
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
OS DATA SOLUTIONS GMBH & CO. KG
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
PERMODO GMBH
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device characteristics, Device identifiers,
Non-precise location data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
PLATFORM161 B.V.
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
ADACADO TECHNOLOGIES INC. (DBA ADACADO)
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
BASIS GLOBAL TECHNOLOGIES, INC.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
SMADEX, S.L.U.
Cookie duration: 365 (days).
Data collected and processed: Users’ profiles, Privacy choices, Probabilistic
identifiers, IP addresses, Device characteristics, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
BOMBORA INC.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Authentication-derived identifiers, IP addresses, Device characteristics, Device
identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
EASYMEDIA GMBH
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
REMERGE GMBH
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, IP addresses,
Device characteristics, Device identifiers, Non-precise location data
more
Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ADVANCED STORE GMBH
Cookie duration: 365 (days).
Data collected and processed: Device identifiers
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
MAGNITE CTV, INC.
Cookie duration: 366 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Precise
location data, Device identifiers, Non-precise location data
more
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
DELTA PROJECTS AB
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
USEMAX ADVERTISEMENT (EMEGO GMBH)
Cookie duration: 365 (days).
Data collected and processed: Users’ profiles
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
EMETRIQ GMBH
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
PUBLICIS MEDIA GMBH
Cookie duration: 1825 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
M.D. PRIMIS TECHNOLOGIES LTD.
Cookie duration: 25 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Device
identifiers, Non-precise location data, User-provided data
more
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ONETAG LIMITED
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
CLOUD TECHNOLOGIES S.A.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session.
View details | Privacy policylaunch
Consent
SMARTOLOGY LIMITED
Doesn't use cookies.
Data collected and processed: IP addresses
more
Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
IMPROVE DIGITAL
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ADOBE ADVERTISING CLOUD
Cookie duration: 365 (days).
Data collected and processed: Privacy choices, Authentication-derived
identifiers, IP addresses, Device identifiers
more
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
BANNERFLOW AB
Cookie duration: 366 (days).
Data collected and processed: IP addresses
more
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
TABMO SAS
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
INTEGRAL AD SCIENCE (INCORPORATING ADMANTX)
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Non-precise location data
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
WIZALY
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Authentication-derived identifiers, IP addresses, Device characteristics,
Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
WEBORAMA
Cookie duration: 393 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
JIVOX CORPORATION
Cookie duration: 30 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Precise location data, Device identifiers,
Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
MOBILE PROFESSIONALS BV / SAGE+ARCHER BV
Doesn't use cookies.
Data collected and processed: Non-precise location data
more
View details | Privacy policylaunch
Consent
ON DEVICE RESEARCH LIMITED
Cookie duration: 30 (days).
Data collected and processed: Browsing and interaction data, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data, User-provided data
more
View details | Storage details | Privacy policylaunch
Consent
ROCKABOX MEDIA LTD
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, IP addresses,
Device characteristics, Non-precise location data
more
View details | Storage details | Privacy policylaunch
Legitimate interesthelp_outline
EXACTAG GMBH
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Authentication-derived identifiers, IP addresses, Device characteristics, Device
identifiers
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
CELTRA INC.
Doesn't use cookies.
Data collected and processed: IP addresses, Device characteristics, Precise
location data, Device identifiers
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
MAINADV SRL
Cookie duration: 30 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
GEMIUS SA
Cookie duration: 1825 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Device characteristics, Device identifiers
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
THE KANTAR GROUP LIMITED
Cookie duration: 914 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
NIELSEN MEDIA RESEARCH LTD.
Cookie duration: 120 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
SOLOCAL SA
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device characteristics, Precise location data,
Device identifiers, Non-precise location data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
PIXALATE, INC.
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, IP addresses,
Device characteristics, Device identifiers, Non-precise location data
more
View details | Storage details | Privacy policylaunch
Consent
ORACLE ADVERTISING
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, Device characteristics,
Device identifiers, Non-precise location data, User-provided data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
NUMBERLY
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
AUDIENCEPROJECT APS
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
DEMANDBASE, INC.
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
EFFILIATION / EFFINITY
Cookie duration: 2 (days).
Data collected and processed: Device characteristics
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
SEENTHIS AB
Doesn't use cookies.
Data collected and processed: IP addresses, Device characteristics
more
View details | Privacy policylaunch
COMMANDERS ACT
Cookie duration: 365 (days).
Data collected and processed: IP addresses, Device identifiers
more
View details | Storage details | Privacy policylaunch
Consent
TRAVEL AUDIENCE GMBH
Cookie duration: 397 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Probabilistic identifiers, Authentication-derived identifiers, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
HUMAN
Doesn't use cookies.
Data collected and processed: Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
BLENDEE SRL
Cookie duration: 366 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
INNOVID LLC
Cookie duration: 90 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
PAPIRFLY AS
Doesn't use cookies.
Data collected and processed: Device characteristics
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
NEUSTAR, INC., A TRANSUNION COMPANY
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
SALESFORCE.COM, INC.
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, Device characteristics,
Device identifiers, Non-precise location data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
VERVE GROUP EUROPE GMBH
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
OTTO (GMBH & CO KG)
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, IP addresses, Device identifiers, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ADOBE AUDIENCE MANAGER, ADOBE EXPERIENCE PLATFORM
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, Authentication-derived identifiers,
IP addresses, Device characteristics, Precise location data, Device identifiers,
Non-precise location data, User-provided data
more
Cookie duration resets each session.
View details | Privacy policylaunch
Consent
LOCALSENSOR B.V.
Doesn't use cookies.
Data collected and processed: Privacy choices, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
ONLINE SOLUTION
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Precise location data, Device identifiers, Non-precise location
data, User-provided data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
Consent
RELAY42 NETHERLANDS B.V.
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, User-provided data
more
View details | Storage details | Privacy policylaunch
Consent
GP ONE GMBH
Cookie duration: Uses session cookies.
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Non-precise location data, User-provided data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
THE MEDIAGRID INC.
Cookie duration: 365 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Probabilistic identifiers, IP addresses, Device characteristics, Precise
location data, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
MINDTAKE RESEARCH GMBH
Cookie duration: 180 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Probabilistic identifiers, IP addresses, Device characteristics, Device
identifiers
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
CINT AB
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers
more
View details | Privacy policylaunch
Consent
GOOGLE ADVERTISING PRODUCTS
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
Uses other forms of storage.
View details | Storage details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
GFK SE
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data, User-provided
data
more
Uses other forms of storage.
View details | Privacy policylaunch
Consent
REVJET
Cookie duration: 730 (days).
Data collected and processed: Users’ profiles, Privacy choices, IP addresses,
Device identifiers, Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
PROTECTED MEDIA LTD
Doesn't use cookies.
Data collected and processed: Browsing and interaction data, Probabilistic
identifiers, IP addresses, Device characteristics, Device identifiers
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
CLINCH LABS LTD
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Probabilistic identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ORACLE DATA CLOUD - MOAT
Doesn't use cookies.
Data collected and processed: IP addresses, Non-precise location data
more
View details | Privacy policylaunch
Legitimate interesthelp_outline
HEARTS AND SCIENCE MÜNCHEN GMBH
Cookie duration: 60 (days).
Data collected and processed: IP addresses
more
Cookie duration resets each session.
View details | Privacy policylaunch
Consent
AMAZON ADVERTISING
Cookie duration: 396 (days).
Data collected and processed: Browsing and interaction data, Users’ profiles,
Privacy choices, Authentication-derived identifiers, IP addresses, Device
characteristics, Device identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Storage details | Privacy policylaunch
Consent
MOLOCO, INC.
Cookie duration: 730 (days).
Data collected and processed: IP addresses, Device characteristics, Device
identifiers, Non-precise location data
more
Cookie duration resets each session. Uses other forms of storage.
View details | Privacy policylaunch
ConsentLegitimate interesthelp_outline
ADTRIBA GMBH
Cookie duration: 730 (days).
Data collected and processed: Browsing and interaction data, Privacy choices,
Authentication-derived identifiers, IP addresses, Device characteristics, Device
identifiers, Non-precise location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
OBJECTIVE PARTNERS BV
Cookie duration: 90 (days).
Data collected and processed: Device identifiers
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
ENSIGHTEN
Cookie duration: 1825 (days).
Data collected and processed: Browsing and interaction data, Privacy choices, IP
addresses, Device characteristics, Device identifiers
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Legitimate interesthelp_outline
EBAY INC
Cookie duration: 90 (days).
Data collected and processed: Privacy choices, IP addresses, Device
characteristics
more
View details | Storage details | Privacy policylaunch
Consent
HURRA COMMUNICATIONS GMBH
Cookie duration: 366 (days).
Data collected and processed: Authentication-derived identifiers, IP addresses,
Device characteristics, Precise location data, Device identifiers, Non-precise
location data
more
Cookie duration resets each session.
View details | Storage details | Privacy policylaunch
Consent
Ad partners
help_outline
GSKINNER
Privacy policylaunch
Consent
AKAMAI
Privacy policylaunch
Consent
FACEBOOK
Privacy policylaunch
Consent
AUNICA
Privacy policylaunch
Consent
BOOKING.COM
Privacy policylaunch
Consent
C3 METRICS
Privacy policylaunch
Consent
IBM
Privacy policylaunch
Consent
EVIDON
Privacy policylaunch
Consent
CUBED
Privacy policylaunch
Consent
OPTOMATON
Privacy policylaunch
Consent
INTELLIAD
Privacy policylaunch
Consent
ANALIGHTS
Privacy policylaunch
Consent
DSTILLERY
Privacy policylaunch
Consent
MEDIAMATH
Privacy policylaunch
Consent
DMA INSTITUTE
Privacy policylaunch
Consent
ZMS
Privacy policylaunch
Consent
DENTSU AEGIS NETWORK
Privacy policylaunch
Consent
IGNITION ONE
Privacy policylaunch
Consent
OMNICOM MEDIA GROUP
Privacy policylaunch
Consent
DIGISEG
Privacy policylaunch
Consent
RESONATE
Privacy policylaunch
Consent
SOJERN
Privacy policylaunch
Consent
HAENSEL AMS
Privacy policylaunch
Consent
BDSK HANDELS GMBH & CO. KG
Privacy policylaunch
Consent
VIDEOLOGY
Privacy policylaunch
Consent
TRADEDOUBLER AB
Privacy policylaunch
Consent
TRUSTARC
Privacy policylaunch
Consent
TRUEFFECT
Privacy policylaunch
Consent
MARKETING SCIENCE CONSULTING GROUP, INC.
Privacy policylaunch
Consent
DENTSU
Privacy policylaunch
Consent
ESSENS
Privacy policylaunch
Consent
TRAVEL DATA COLLECTIVE
Privacy policylaunch
Consent
ADVOLUTION.CONTROL
Privacy policylaunch
Consent
WIDESPACE
Privacy policylaunch
Consent
LIFESTREET
Privacy policylaunch
Consent
VIMEO
Privacy policylaunch
Consent
BATCH MEDIA
Privacy policylaunch
Consent
VODAFONE GMBH
Privacy policylaunch
Consent
MAGNITE
Privacy policylaunch
Consent
SCENESTEALER
Privacy policylaunch
Consent
NETQUEST
Privacy policylaunch
Consent
MANAGE.COM
Privacy policylaunch
Consent
CLOUDFLARE
Privacy policylaunch
Consent
HAVAS MEDIA FRANCE - DBI
Privacy policylaunch
Consent
NETFLIX
Privacy policylaunch
Consent
MACROMILL GROUP
Privacy policylaunch
Consent
EBUILDERS
Privacy policylaunch
Consent
APPLOVIN CORP.
Privacy policylaunch
Consent
NANO INTERACTIVE
Privacy policylaunch
Consent
FRACTIONAL MEDIA
Privacy policylaunch
Consent
RACKSPACE
Privacy policylaunch
Consent
LIFTOFF
Privacy policylaunch
Consent
MSI-ACI
Privacy policylaunch
Consent
ARRIVALIST
Privacy policylaunch
Consent
NAVEGG
Privacy policylaunch
Consent
ADMEDO
Privacy policylaunch
Consent
KOCHAVA
Privacy policylaunch
Consent
MOBITRANS
Privacy policylaunch
Consent
ADEX
Privacy policylaunch
Consent
IMPACT
Privacy policylaunch
Consent
SPOTAD
Privacy policylaunch
Consent
AARKI
Privacy policylaunch
Consent
SFR
Privacy policylaunch
Consent
CABLATO
Privacy policylaunch
Consent
WAYSTACK
Privacy policylaunch
Consent
TRESENSA
Privacy policylaunch
Consent
ADLUDIO
Privacy policylaunch
Consent
Accept all
Confirm choices
Close