Flume和kafka完成实时日志数据采集

agent 选型 A机器 exec source +memory channel +avro sink B_1机器 avro source +memory channel +logger sink B_2机器 avro source +memory channel +kafka sink A服务器配置exec-memory-avro.conf# exec-memory-avro.conf: A single-node Flume configuration...

阅读全文

keepalived+nginx高可用部署实例

安装keepalived安装命令yum install keepalived -y查看是否安装成功,使用如下命令能看到版本号,表示成功rpm -q -a keepalived使用yum命令安装keepalived成功后,在/etc/keepalived目录下有keepalived.conf配置文件,高可用配置就是主要配置该文件cd /etc/keepalivedvi keepalived.conf主机的keepalived.conf的配置内容如下主监控MASTER配置#---------

阅读全文

nacos部署及服务开发运行

--安装mysql--注:完成安装需要建立数据库nacos_config,安装mysql8报密码校验错误,执行/*************************************/1、修改用户密码加密规则ALTER USER 'root'@'%' IDENTIFIED BY 'password' PASSWORD EXPIRE NEVER;2、更新用户密码ALTER USER 'root'@'%' IDENTIFIED WITH mysql_native_passwor

阅读全文

docker部署安装nacos集群说明

docker部署安装nacos集群说明--安装mysql--注:完成安装需要建立数据库nacos_config,执行官方脚本docker run --name mysql01 --restart=always \-p 3306:3306 \--net mynetwork --ip 172.18.0.10 --privileged=true \-e TZ=Asia/Shanghai \-v /kdata/mysql/conf:/etc/mysql/conf.d \-v /kdata/mys

阅读全文

python爬取当前文章记录修正版

#encoding:UTF-8#测试爬虫例子#爬取网页内容,保存数据库,#下载图片,上传七牛云#!/usr/bin/python3# encoding:utf-8'''Created on 2020-04-21 08:20@author: kingres = requests.get(url,params=data,headers = headers)res = requests.post(url, data=json_data, headers = headers)'''impor

阅读全文

配置springboot日志logback信息备忘

<?xml version="1.0" encoding="UTF-8"?><!--scan:当此属性设置为true时,配置文件如果发生改变,将会被重新加载,默认值为true。scanPeriod:设置监测配置文件是否有修改的时间间隔,如果没有给出时间单位,默认单位是毫秒当scan为true时,此属性生效。默认的时间间隔为1分钟。debug:当此属性设置为true时,将打印出logback内部日志信息,实时查看logback运行状态。默认值为false。--><co

阅读全文

nginx配置与说明备忘

拉取镜像docker pull nginx运行nginx镜像并进入容器docker run -ti nginx /bin/bash把文件挂载开放docker run -p 80:80 -p 443:443 \-v /kdatas/docker/nginx/conf:/etc/nginx/conf.d \-v /kdatas/docker/nginx/cert:/etc/nginx/cert \-v /kdatas/docker/nginx/www:/usr/share/nginx/html

阅读全文

python爬取当前(CSDN)文章更新

#encoding:UTF-8#测试爬虫例子#爬取网页内容,保存数据库,#下载图片,上传七牛云#!/usr/bin/python3# encoding:utf-8'''Created on 2020-11-11 08:20@author: kingres = requests.get(url,params=data,headers = headers)res = requests.post(url, data=json_data, headers = headers)'''impo.

阅读全文

elasticsearch:7.10.0安装部署记录信息

--------------------------elasticsearch:7.9.3安装记录-------------------------subnet网段地址。docker network ls查看docker网卡docker network inspect 网卡id删除docker网卡docker network rm 网卡iddocker network inspect mynetwork查看docker网卡的相关详细信息创建网络ipdocker network cre

阅读全文

根据传过来的word转换为pdf

package com.fssi.pdfconvert.service.pdfpreview.impl;import com.fssi.framework.common.utils.CommonUtil;import com.fssi.pdfconvert.config.ConfigConstants;import com.fssi.pdfconvert.model.ReturnResponse;import com.fssi.pdfconvert.model.pdfpreview.FileAtt

阅读全文

SpringBoot+elastisearch7.9高亮搜索信息

SpringBoot+elastisearch7.9高亮搜索信息//分页参数Pageable pageable = PageRequest.of(pageNum, pageSize);NativeSearchQueryBuilder nativeSearchQueryBuilder = new NativeSearchQueryBuilder();//限制返回数据信息nativeSearchQueryBuilder.withSourceFilter(new FetchSourceFilter(ne

阅读全文

docker部署elasticsearch+kibana

linux部署复制文件到kdatacd kdata解压:tar -zxvf elasticsearch-7.9.0-linux-x86_64.tar.gz目录重命名:mv elasticsearch-7.9.0 elasticsearch修改配置:cd elasticsearch/configvi jvm.options修改默认配置:-Xms1g -Xmx1g 为 -Xms512m -Xmx512m编辑elasticsearch.yml修改数据和日志目录vi elastic

阅读全文

python爬取当前文章记录升级

#encoding:UTF-8#测试爬虫例子#爬取网页内容,保存数据库,#下载图片,上传七牛云#!/usr/bin/python3# encoding:utf-8'''Created on 2020-08-13 23:20@author: kingres = requests.get(url,params=data,headers = headers)res = requests.post(url, data=json_data, headers = headers)'''impor

阅读全文

docker使用实例

删除 Docker CE$ sudo yum remove docker-ce$ sudo rm -rf /var/lib/docker安装redisdocker run -d --name redis -p6379:6379 -v redis:/data -e requirepass="123456" redis --appendonly yes -name redis-server : 指定容器名称 -p 6379:6379 : 端口映射--requitepass "redis123"

阅读全文

python生成二维码并存储数据库

import pymysqlfrom PIL import Imageimport qrcode#生成二维码工具类型#根据数据库数据class kqrcode(object): """docstring for ClassName""" def __init__(self, arg): super(kqrcode, self).__init__() #根据数据库数据 self.arg = arg def get_data():

阅读全文

python爬取当前文章记录

#encoding:UTF-8#测试爬虫例子#!/usr/bin/python3# encoding:utf-8'''Created on 2020-04-21 08:20@author: kingres = requests.get(url,params=data,headers = headers)res = requests.post(url, data=json_data, headers = headers)'''import requestsfrom bs4 import

阅读全文

go爬虫生成文件夹并爬取图片

package mainimport (“fmt”“github.com/PuerkitoBio/goquery”“io/ioutil”“net/http”“os”“strconv”“time”)//创建文件夹func CreateDateDir(basePath string) {_, err := os.Stat("./images/"+basePath)if err != nil {fmt.Println(“不存在文件”)if os.IsNotExist(err) {.

阅读全文

统一监听jwttoken的校验

package com.k5003.gatewayzuul.config;import com.k5003.gatewayzuul.service.GatewayService;import org.apache.commons.lang.StringUtils;import org.springframework.beans.factory.annotation.Autowired;im...

阅读全文

封装easyui模块化

K.define(‘kuser.kuserment’,{kpartname:‘测试用户管理’,//模块名称gridid:“kuser_gridlist”,//表格列表idaddwin:“kuser_addwin”,//添加弹出win idupdwim:“kuser_updatewin”,//修改弹出win ideditFlag:undefined,/* 初始化* @param me...

阅读全文

python爬取图片并创建文件夹保存

#coding=utf-8import urllibimport urllib.requestfrom urllib.error import URLError, HTTPErrorimport stringimport timeimport reimport sys,osfrom bs4 import BeautifulSoup#获取连接内容def get_imghtml(u...

阅读全文

nodejs+express统一代理配置

var createError = require(‘http-errors’);var express = require(‘express’);var path = require(‘path’);var cookieParser = require(‘cookie-parser’);var logger = require(‘morgan’);var history = requi...

阅读全文

权限管理系统表设计

----------------------------权限信息管理用到-------------------------------------------–用户信息表CREATE TABLE k_user (id bigint(11) NOT NULL AUTO_INCREMENT COMMENT ‘编号’,account varchar(50) NOT NULL COMMENT ‘用...

阅读全文

extjs网站后台

extjs网站后台代码地址:https://download.csdn.net/download/qqjjj/12308544

阅读全文