Elasticsearch索引编制失败OnCommand Insight 中的发生原因性能问题

最后更新
另存为PDF

Views:: 16

Visibility:: Public

Votes:: 0

Category:: oncommand-insight<a>OCI</a><a>弹性搜索</a><a>OnCommand 数据仓库(DWH)</a><a>OnCommand Insight</a><a>1074147</a>

Specialty:: oci

Last Updated:

适用场景

OnCommand Insight (OCI) 7.x

问题描述

以下列出了与在弹性搜索中索引失败相关的问题。这些信息可以一起或单独查看。

WebUI搜索速度较慢
OCI服务器上的CPU使用率较高
OCI服务器上的内存使用率较高
OCI服务器上的文件系统接近全满/全满
尝试访问WebUI时出现404 Page not found错误消息
数据源失败、并显示错误"Internal error: Cannot update server (Server returned HTTP response code: 500 for URL"

在server_indexer.log (位于 \SANscreen\wildfly\standalone\log)中、您可能会看到失败的索引消息、类似于：

2018-01-15 20:35:00,436 ERROR [EJB default - 7] QueryIndexBuilder (QueryIndexBuilder.java:195) - Error indexing InternalVolume

 com.netapp.oci.es.ElasticsearchException: [bulkIndexById][INDEX_NAME:oci-inventory-internalvolume-2018-01-15-20-33] [ANOMALY_INDEX_TYPE: internalvolume] [IDS: [7864440,

Caused by: com.netapp.oci.es.ElasticsearchException: Error bulk indexing data. failure in bulk

execution:

[19439]: index [oci-inventory-internalvolume-2018-01-23-07-56], type [internalvolume], id [11609

24], message [java.lang.IllegalArgumentException: Document contains at least one immense term

in field="annotationValues.text.Automounter Path" (whose UTF8 encoding is longer than the max l

ength 32766), all of which were skipped. Please correct the analyzer to not produce such terms. T

he prefix of the first immense term is: '[47, 105, 99, 101, 110, 103, 47, 100, 102, 109, 47, 114, 103,

98, 44, 32, 47, 105, 99, 101, 110, 103, 47, 100, 102, 109, 47, 98, 108, 97]...', original message: by

tes can be at most 32766 in length; got 37802]

在server.log (位于 \SANscreen\wildfly\standalone\log)中、您可能会看到类似以下内容的失败消息：

2019-06-18 07:11:26,296 ERROR [default task-33057] OriginatorWorkingSet(OriginatorWorkingSet.java:488) - <datasource> failed on submit, due to: Errors encountered while executing delete extendedData documents. failure in bulk execution: [0]: index [oci-extended-data-v2], type [_doc], id [1871197], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [1]: index [oci-extended-data-v2], type [_doc], id [3310508], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [2]: index [oci-extended-data-v2], type [_doc], id [1567170], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [3]: index [oci-extended-data-v2], type [_doc], id [4478203], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [4]: index [oci-extended-data-v2], type [_doc], id [4311330], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]]

在oci-cluster.log (位于 \SANscreen\program_data\elasticsearch\logs)中、您可能会看到类似以下内容的失败消息：

[2018-03-26T17:55:13,054][WARN ][o.e.c.a.s.ShardStateAction] [<datasource>] [oci-timeseries-qtree-2018-03-11][1] received shard failed for shard id [[oci-timeseries-qtree-2018-03-11][1]], allocation id [sSKYeTqNR46jrWY-rGw1XA], primary term [0], message [failed recovery], failure [RecoveryFailedException[[oci-timeseries-qtree-2018-03-11][1]: Recovery failed on {XXXXXXXX}{6HO5LMOIRYCEAWKINLSCIQ {TB2VITKTREOZQLBQLXWMIG}{127.0.0.1}{127.0.0.1:9310}]; nested: IndexShardRecoveryException[failed recovery]; nested: IllegalStateException[pre-1.4 translog found [F:\NetApp\SANscreen\program_data\elasticsearch\data\nodes\0\indices\KeESoUKHROaLhn6_WseZVQ\1\translog\translog-1.tlog]]; ] org.elasticsearch.indices.recovery.RecoveryFailedException: [oci-timeseries-qtree-2018-03-11][1]: Recovery failed on {XXXXXXXX}{6HO5LMOIRYCEAWKINLSCIQ}{TB2VITKTREOZQLBQLXWMIG}{127.0.0.1}{127.0.0.1:9310}

Caused by: org.elasticsearch.index.shard.IndexShardRecoveryException: failed recovery at org.elasticsearch.index.shard.StoreRecovery.executeRecovery(StoreRecovery.java:299) ~[elasticsearch-5.4.2.jar:5.4.2] at org.elasticsearch.index.shard.StoreRecovery.recoverFromStore(StoreRecovery.java:88) ~[elasticsearch-5.4.2.jar:5.4.2] at org.elasticsearch.index.shard.IndexShard.recoverFromStore(IndexShard.java:1238) ~[elasticsearch-5.4.2.jar:5.4.2] at org.elasticsearch.index.shard.IndexShard.lambda$startRecovery$1(IndexShard.java:1486) ~[elasticsearch-5.4.2.jar:5.4.2] ... 4 more Caused by: java.lang.IllegalStateException: pre-1.4 translog found [F:\NetApp\SANscreen\program_data\elasticsearch\data\nodes\0\indices\KeESoUKHROaLhn6_WseZVQ\1\translog\translog-1.tlog]