本文是第二篇!
第一篇,《Java高級(jí)架構(gòu)之FastDFS分布式文件集群》:https://blog.51cto.com/xvjunjie/2377669
第三篇,《FastDFS的HA架構(gòu)多Group多Storage多Tracker結(jié)合SpringBoot》https://blog.51cto.com/xvjunjie/2445770
創(chuàng)新互聯(lián)專(zhuān)業(yè)提供成都服務(wù)器托管服務(wù),為用戶(hù)提供五星數(shù)據(jù)中心、電信、雙線(xiàn)接入解決方案,用戶(hù)可自行在線(xiàn)購(gòu)買(mǎi)成都服務(wù)器托管服務(wù),并享受7*24小時(shí)金牌售后服務(wù)。
SpringBoot是由Pivotal團(tuán)隊(duì)提供的全新框架,其設(shè)計(jì)目的是用來(lái)簡(jiǎn)化新Spring應(yīng)用的初始搭建以及開(kāi)發(fā)過(guò)程。該框架使用了特定的方式來(lái)進(jìn)行配置,從而使開(kāi)發(fā)人員不再需要定義樣板化的配置。通過(guò)這種方式,Spring Boot致力于在蓬勃發(fā)展的快速應(yīng)用開(kāi)發(fā)領(lǐng)域(rapid application development)成為領(lǐng)導(dǎo)者。
創(chuàng)建獨(dú)立的Spring應(yīng)用程序
嵌入的Tomcat,無(wú)需部署WAR文件
簡(jiǎn)化Maven配置
自動(dòng)配置Spring
提供生產(chǎn)就緒型功能,如指標(biāo),健康檢查和外部配置
概述
Nginx(engine x)是一個(gè)開(kāi)源的,支持高并發(fā)的www服務(wù)和代理服務(wù)軟件。Nginx是俄羅斯人Igor Sysoev開(kāi)發(fā)的,最初被應(yīng)用到俄羅斯的大型網(wǎng)站(www.rambler.ru)上。后來(lái)作者將源代碼以類(lèi)BSD許可證的形式開(kāi)源出來(lái)供全球使用。在功能應(yīng)用方面,Nginx不僅是一個(gè)優(yōu)秀的Web服務(wù)軟件,還具有反向代理負(fù)載均衡和緩存的功能。在反向代理負(fù)載均衡方面類(lèi)似于LVS負(fù)載均衡及HAProxy等你專(zhuān)業(yè)代理軟件。Nginx部署起來(lái)更加方便簡(jiǎn)單,在緩存服務(wù)功能方面,有類(lèi)似于Squid等專(zhuān)業(yè)的緩存服務(wù)軟件。Nginx可以運(yùn)行在UNIX、Linux、MS Windows Server、Mac OS X Server、Solaris等操作系統(tǒng)中。
Nginx的重要特性
Nginx所具備的WWW服務(wù)特性
Nginx軟件主要企業(yè)應(yīng)用
Web服務(wù)應(yīng)用產(chǎn)品性能對(duì)比
為什么Nginx比Apache的性能高?
如何正確采用Web服務(wù)器?
關(guān)于部署,就不在重復(fù)了,如果需要請(qǐng)移步《Java高級(jí)架構(gòu)之FastDFS分布式文件集群》:https://blog.51cto.com/xvjunjie/2377669
<dependencies>
<!-- SpringBoot的自動(dòng)配置相關(guān)依賴(lài) -->
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-autoconfigure</artifactId>
<version>1.5.20.RELEASE</version>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-configuration-processor</artifactId>
<version>1.5.20.RELEASE</version>
</dependency>
<!-- 日志相關(guān)的依賴(lài) -->
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-logging</artifactId>
<version>1.5.20.RELEASE</version>
</dependency>
<!-- 對(duì)象池相關(guān)的依賴(lài) -->
<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-pool2</artifactId>
<version>2.6.0</version>
</dependency>
</dependencies>
annotation
:存放相關(guān)的注解
autoconfiguation
: 存儲(chǔ)自動(dòng)配置類(lèi)
factory
: 存放工廠(chǎng)類(lèi)
properties
: 存放配置參數(shù)類(lèi)
service
: 存放服務(wù)類(lèi)一般情況下,SpringBoot都會(huì)提供相應(yīng)的@EnableXxx
注解標(biāo)注在應(yīng)用的主啟動(dòng)類(lèi)上開(kāi)啟某個(gè)功能:
// EnableFastdfsClient.java
@Target(ElementType.TYPE)
@Retention(RetentionPolicy.RUNTIME)
@Import(FastdfsAutoConfiguration.class)
@Documented
public @interface EnableFastdfsClient {
}
下面是相關(guān)的自動(dòng)配置類(lèi):
// FastdfsAutoConfiguration.java
@Configuration
@EnableConfigurationProperties(FastdfsProperties.class)
public class FastdfsAutoConfiguration {
@Autowired
private FastdfsProperties fastdfsProperties;
@Bean
@ConditionalOnMissingBean(FastdfsClientService.class)
public FastdfsClientService fastdfsClientService() throws Exception {
return new FastdfsClientService(fastdfsProperties);
}
}
創(chuàng)建相關(guān)的工廠(chǎng)類(lèi):
// StorageClientFactory.java
// 用于創(chuàng)建連接對(duì)象的工廠(chǎng)類(lèi)
public class StorageClientFactory implements PooledObjectFactory<StorageClient> {
@Override
public PooledObject<StorageClient> makeObject() throws Exception {
TrackerClient client = new TrackerClient();
TrackerServer server = client.getConnection();
return new DefaultPooledObject<>(new StorageClient(server, null));
}
@Override
public void destroyObject(PooledObject<StorageClient> p) throws Exception {
p.getObject().getTrackerServer().close();
}
@Override
public boolean validateObject(PooledObject<StorageClient> p) {
return false;
}
@Override
public void activateObject(PooledObject<StorageClient> p) throws Exception {
}
@Override
public void passivateObject(PooledObject<StorageClient> p) throws Exception {
}
}
Properties類(lèi)用來(lái)映射application.properties或者application.yml配置文件:
// FastdfsProperties.java
@ConfigurationProperties(prefix = "fastdfs")
public class FastdfsProperties {
// 連接超時(shí)時(shí)間
// 網(wǎng)絡(luò)超時(shí)時(shí)間
// 字符集編碼
// 是否使用Token
// Token加密密鑰
// 跟蹤器IP地址,多個(gè)使用分號(hào)隔開(kāi)
// 連接池的連接對(duì)象最大個(gè)數(shù)
// 連接池的最大空閑對(duì)象個(gè)數(shù)
// 連接池的最小空閑對(duì)象個(gè)數(shù)
// Nginx服務(wù)器IP,多個(gè)使用分號(hào)分割
// 獲取連接對(duì)象時(shí)可忍受的等待時(shí)長(zhǎng)(毫秒)
private String connectTimeout = "5";
private String networkTimeout = "30";
private String charset = "UTF-8";
private String httpAntiStealToken = "false";
private String httpSecretKey = "";
private String httpTrackerHttpPort = "";
private String trackerServers = "";
private String connectionPoolMaxTotal = "18";
private String connectionPoolMaxIdle = "18";
private String connectionPoolMinIdle = "2";
private String nginxServers = "";
// 需要?jiǎng)?chuàng)建相關(guān)的Setter和Getter方法
}
在Service類(lèi)中封裝方法, 下面僅展示3個(gè)常用的方法:
// FastdfsClientSerivce.java
public class FastdfsClientService {
// SpringBoot加載的配置文件
// 連接池配置項(xiàng)
// 轉(zhuǎn)換后的配置條目
// 連接池
// Nginx服務(wù)器地址
private FastdfsProperties fdfsProp;
private GenericObjectPoolConfig config;
private Properties prop;
private GenericObjectPool<StorageClient> pool;
private String[] nginxServers;
private Logger logger;
public FastdfsClientService(FastdfsProperties fdfsProp) throws Exception {
this.fdfsProp = fdfsProp;
this.logger = LoggerFactory.getLogger(getClass());
init();
create();
info();
}
/**
* 初始化全局客戶(hù)端
*/
private void init() throws Exception {
this.prop = new Properties();
this.logger.info("FastDFS: reading config file...");
this.logger.info("FastDFS: fastdfs.connect_timeout_in_seconds=" + this.fdfsProp.getConnectTimeout());
this.logger.info("FastDFS: fastdfs.network_timeout_in_seconds=" + this.fdfsProp.getNetworkTimeout());
this.logger.info("FastDFS: fastdfs.charset=" + this.fdfsProp.getCharset());
this.logger.info("FastDFS: fastdfs.http_anti_steal_token=" + this.fdfsProp.getHttpAntiStealToken());
this.logger.info("FastDFS: fastdfs.http_secret_key=" + this.fdfsProp.getHttpSecretKey());
this.logger.info("FastDFS: fastdfs.http_tracker_http_port=" + this.fdfsProp.getHttpTrackerHttpPort());
this.logger.info("FastDFS: fastdfs.tracker_servers=" + this.fdfsProp.getTrackerServers());
this.logger.info("FastDFS: fastdfs.connection_pool_max_total=" + this.fdfsProp.getConnectionPoolMaxTotal());
this.logger.info("FastDFS: fastdfs.connection_pool_max_idle=" + this.fdfsProp.getConnectionPoolMaxIdle());
this.logger.info("FastDFS: fastdfs.connection_pool_min_idle=" + this.fdfsProp.getConnectionPoolMinIdle());
this.logger.info("FastDFS: fastdfs.nginx_servers=" + this.fdfsProp.getNginxServers());
this.prop.put("fastdfs.connect_timeout_in_seconds", this.fdfsProp.getConnectTimeout());
this.prop.put("fastdfs.network_timeout_in_seconds", this.fdfsProp.getNetworkTimeout());
this.prop.put("fastdfs.charset", this.fdfsProp.getCharset());
this.prop.put("fastdfs.http_anti_steal_token", this.fdfsProp.getHttpAntiStealToken());
this.prop.put("fastdfs.http_secret_key", this.fdfsProp.getHttpSecretKey());
this.prop.put("fastdfs.http_tracker_http_port", this.fdfsProp.getHttpTrackerHttpPort());
this.prop.put("fastdfs.tracker_servers", this.fdfsProp.getTrackerServers());
ClientGlobal.initByProperties(this.prop);
}
/**
* 顯示初始化信息
*/
private void info() {
this.logger.info("FastDFS parameter: ConnectionPoolMaxTotal ==> " + this.pool.getMaxTotal());
this.logger.info("FastDFS parameter: ConnectionPoolMaxIdle ==> " + this.pool.getMaxIdle());
this.logger.info("FastDFS parameter: ConnectionPoolMinIdle ==> " + this.pool.getMinIdle());
this.logger.info("FastDFS parameter: NginxServer ==> " + Arrays.toString(this.nginxServers));
this.logger.info(ClientGlobal.configInfo());
}
/**
* 創(chuàng)建連接池
*/
private void create() {
this.config = new GenericObjectPoolConfig();
this.logger.info("FastDFS Client: Creating connection pool...");
this.config.setMaxTotal(Integer.parseInt(this.fdfsProp.getConnectionPoolMaxTotal()));
this.config.setMaxIdle(Integer.parseInt(this.fdfsProp.getConnectionPoolMaxIdle()));
this.config.setMinIdle(Integer.parseInt(this.fdfsProp.getConnectionPoolMinIdle()));
StorageClientFactory factory = new StorageClientFactory();
this.pool = new GenericObjectPool<StorageClient>(factory, this.config);
this.nginxServers = this.fdfsProp.getNginxServers().split(",");
}
/**
* Nginx服務(wù)器負(fù)載均衡算法
*
* @param servers 服務(wù)器地址
* @param address 客戶(hù)端IP地址
* @return 可用的服務(wù)器地址
*/
private String getNginxServer(String[] servers, String address) {
int size = servers.length;
int i = address.hashCode();
int index = abs(i % size);
return servers[index];
}
/**
* 帶有防盜鏈的下載
*
* @param fileGroup 文件組名
* @param remoteFileName 遠(yuǎn)程文件名稱(chēng)
* @param clientIpAddress 客戶(hù)端IP地址
* @return 完整的URL地址
*/
public String autoDownloadWithToken(String fileGroup, String remoteFileName, String clientIpAddress) throws Exception {
int ts = (int) (System.currentTimeMillis() / 1000);
String token = ProtoCommon.getToken(remoteFileName, ts, ClientGlobal.getG_secret_key());
String nginx = this.getNginxServer(this.nginxServers, clientIpAddress);
return "http://" + nginx + "/" + fileGroup + "/" + remoteFileName + "?token=" + token + "&ts=" + ts;
}
/**
* 上傳文件,適合上傳圖片
*
* @param buffer 字節(jié)數(shù)組
* @param ext 擴(kuò)展名
* @return 文件組名和ID
*/
public String[] autoUpload(byte[] buffer, String ext) throws Exception {
String[] upload = this.upload(buffer, ext, null);
return upload;
}
/**
* 不帶防盜鏈的下載,如果開(kāi)啟防盜鏈會(huì)導(dǎo)致該方法拋出異常
*
* @param fileGroup 文件組名
* @param remoteFileName 遠(yuǎn)程文件ID
* @param clientIpAddress 客戶(hù)端IP地址,根據(jù)客戶(hù)端IP來(lái)分配N(xiāo)ginx服務(wù)器
* @return 完整的URL地址
*/
public String autoDownloadWithoutToken(String fileGroup, String remoteFileName, String clientIpAddress) throws Exception {
if (ClientGlobal.getG_anti_steal_token()) {
this.logger.error("FastDFS Client: You've turned on Token authentication.");
throw new Exception("You've turned on Token authentication.");
}
String nginx = this.getNginxServer(this.nginxServers, clientIpAddress);
return "http://" + nginx + fileGroup + "/" + remoteFileName;
}
// 后面還有好多方法,就不一一展示了
}
為了在IDEA中使用便捷的配置提示功能,我們需要?jiǎng)?chuàng)建元數(shù)據(jù)文件(resources/spring-configuration-metadata.json):
{
"groups": [
{
"name": "fastdfs",
"type": "com.bluemiaomiao.properties.FastdfsProperties",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties"
}
],
"properties": [
{
"name": "connectTimeout",
"type": "java.lang.String",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties",
"defaultValue": "5"
},
{
"name": "networkTimeout",
"type": "java.lang.String",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties",
"defaultValue": "30"
},
{
"name": "charset",
"type": "java.lang.String",
"defaultValue": "UTF-8"
},
{
"name": "httpAntiStealToken",
"type": "java.lang.String",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties",
"defaultValue": "false"
},
{
"name": "httpSecretKey",
"type": "java.lang.String",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties"
},
{
"name": "httpTrackerHttpPort",
"type": "java.lang.Integer",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties"
},
{
"name": "trackerServers",
"type": "java.lang.String",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties"
},
{
"name": "connectionPoolMaxTotal",
"type": "java.lang.Integer",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties",
"defaultValue": "18"
},
{
"name": "connectionPoolMaxIdle",
"type": "java.lang.Integer",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties",
"defaultValue": "18"
},
{
"name": "connectionPoolMinIdle",
"type": "java.lang.Integer",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties",
"defaultValue": "2"
},
{
"name": "nginxServers",
"type": "java.lang.String",
"sourceType": "com.bluemiaomiao.properties.FastdfsProperties"
}
],
"hints": [
{
"name": "http_anti_steal_token",
"values": [
{
"value": "false"
},
{
"value": "true"
}
]
}
]
}
創(chuàng)建SpringBoot項(xiàng)目,勾選Web選項(xiàng),版本選擇1.5.20
進(jìn)入場(chǎng)景啟動(dòng)器的項(xiàng)目目錄執(zhí)行mvn clean install
將其安裝到本地
<dependency>
<groupId>com.bluemiaomiao</groupId>
<artifactId>fastdfs-spring-boot-starter</artifactId>
<version>1.0-SNAPSHOT</version>
</dependency>
記得開(kāi)啟IDEA的自動(dòng)導(dǎo)入功能
fastdfs.nginx-servers=192.168.80.2:8000,192.168.80.3:8000,192.168.80.4:8000
fastdfs.tracker-servers=192.168.80.2:22122,192.168.80.3:22122,192.168.80.4:22122
fastdfs.http-secret-key=2scPwMPctXhbLVOYB0jyuyQzytOofmFCBIYe65n56PPYVWrntxzLIDbPdvDDLJM8QHhKxSGWTcr+9VdG3yptkw
fastdfs.http-anti-steal-token=true
fastdfs.http-tracker-http-port=8080
fastdfs.network-timeout=30
fastdfs.connect-timeout=5
fastdfs.connection-pool-max-idle=18
fastdfs.connection-pool-min-idle=2
fastdfs.connection-pool-max-total=18
fastdfs.charset=UTF-8
或者使用application.yml
fastdfs:
charset: UTF-8
connect-timeout: 5
http-secret-key: 2scPwMPctXhbLVOYB0jyuyQzytOofmFCBIYe65n56PPYVWrntxzLIDbPdvDDLJM8QHhKxSGWTcr+9VdG3yptkw
network-timeout: 30
http-anti-steal-token: true
http-tracker-http-port: 8080
connection-pool-max-idle: 20
connection-pool-max-total: 20
connection-pool-min-idle: 2
nginx-servers: 192.168.80.2:8000,192.168.80.3:8000,192.168.80.4:8000
tracker-servers: 192.168.80.2:22122,192.168.80.3:22122,192.168.80.4:22122
// controllers.DownloadController.java
@Controller
@RequestMapping(value = "/download")
public class DownloadController {
@Autowired
private FastdfsClientService service;
@ResponseBody
@RequestMapping(value = "/image")
public String image() throws Exception {
// 之前上傳過(guò)的數(shù)據(jù),實(shí)際應(yīng)用場(chǎng)景應(yīng)該使用SQL數(shù)據(jù)庫(kù)來(lái)存儲(chǔ)
return service.autoDownloadWithToken("group1", "M00/00/00/wKhQA1ysjSGAPjXbAAVFOL7FJU4.tar.gz", "192.168.80.1");
}
}
網(wǎng)站名稱(chēng):SpringBoot集成FastDFS+Nginx整合基于Token的防盜鏈
本文地址:http://muchs.cn/article6/gecdig.html
成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián),為您提供微信小程序、移動(dòng)網(wǎng)站建設(shè)、自適應(yīng)網(wǎng)站、外貿(mào)建站、網(wǎng)站導(dǎo)航、營(yíng)銷(xiāo)型網(wǎng)站建設(shè)
聲明:本網(wǎng)站發(fā)布的內(nèi)容(圖片、視頻和文字)以用戶(hù)投稿、用戶(hù)轉(zhuǎn)載內(nèi)容為主,如果涉及侵權(quán)請(qǐng)盡快告知,我們將會(huì)在第一時(shí)間刪除。文章觀(guān)點(diǎn)不代表本網(wǎng)站立場(chǎng),如需處理請(qǐng)聯(lián)系客服。電話(huà):028-86922220;郵箱:631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載,或轉(zhuǎn)載時(shí)需注明來(lái)源: 創(chuàng)新互聯(lián)