您好,登錄后才能下訂單哦!
這篇文章給大家介紹Python中如何使用mongodb模塊,內(nèi)容非常詳細(xì),感興趣的小伙伴們可以參考借鑒,希望對(duì)大家能有所幫助。
涉及到python和mongodb,那么安裝相應(yīng)的模塊四必不可少的,最簡(jiǎn)單的安裝方法,或者非pip不可了。
# pip install pymongo==3.0.4
順便也記錄下源碼安裝的方式
# wget https://pypi.python.org/packages/source/p/pymongo/pymongo-2.8.tar.gz#md5=23100361c9af1904eb2d7722f2658114 --no-check-certificate # tar xf pymongo-2.8.tar.gz # cd pymongo-2.8 # python setup.py install
摘自一則日志
35783 s100 android 47 5 192.168.1.100 2015-09-05 08:03:19 strengthenHeroByHeroes {"consume_gold":{"ogold":2893821,"cgold":1700,"gold":2892121,"tag":"strengthenHeroByHeroes"},"taskInfo":[{"id":2310033,"progress":2,"status":0}],"delHeroList":{"id":102014,"id":102014,"id":102014,"id":102010,"id":102010},"id":100026,"olevel":46,"oexp":1700,"cexp":1700,"level":46,"exp":3400} 865982021462182 XiaoMi
入庫(kù)mongodb的python腳本
[root@localhost opt]# cat analytical.py #!/usr/bin/env python #coding:utf8 import os,sys,json from datetime import * from pymongo import MongoClient def ConMongo(host,port,cur_db,username,password): client = MongoClient(host,port) db = client[cur_db] db.authenticate(username,password) table = db.gamelogs return table def parseLog(logfile,table): dic = {} dl = [] with open(file_log) as fd: for line in fd: try: tokens = line.strip().split('\t') uid = tokens[0] server = tokens[1] system = tokens[2] level = int(tokens[3]) vip_level = tokens[4] ip = tokens[5] time = datetime.strptime(tokens[6], "%Y-%m-%d %H:%M:%S") #將時(shí)間字符串轉(zhuǎn)換成時(shí)間格式 action = tokens[7] result = json.loads(tokens[8]) #特殊字符串轉(zhuǎn)換成json格式 uuid = tokens[9] if len(tokens) == 12: channel = tokens[11] else: channel = '' dic = {'uid':uid,'server':server,'system':system,'level':level,'vip_level':vip_level,'ip':ip,'time':time,'action':action,'result':result,'uuid':uuid,'channel':channel} dl.append(dic) if len(dl) == 10000: table.insert_many(dl) dl = [] except Exception,e: print e, line if len(dl) > 0: table.insert_many(dl) if __name__ == '__main__': table = ConMongo('localhost',27017,'talefundb','talefun','123456') try: logfile = sys.argv[1] parseLog(logfile,table) except IndexError,e: print e
注意事項(xiàng):
(1)insert_many參數(shù)是mongodb 3.0.4中新加的,允許你將一個(gè)大列表直接insert到mongodb數(shù)據(jù)庫(kù)中 (2)腳本中做了限制,如果字典中有2000個(gè)值,就向mongodb插入一次數(shù)據(jù),這樣在效率上得到了保證 (3)不建議直接復(fù)制腳本測(cè)試,很多粘貼出來(lái)后,很多制表符等會(huì)出現(xiàn)問(wèn)題。我會(huì)吧腳本放在云盤上大家可以下載,測(cè)試用。
關(guān)于Python中如何使用mongodb模塊就分享到這里了,希望以上內(nèi)容可以對(duì)大家有一定的幫助,可以學(xué)到更多知識(shí)。如果覺得文章不錯(cuò),可以把它分享出去讓更多的人看到。
免責(zé)聲明:本站發(fā)布的內(nèi)容(圖片、視頻和文字)以原創(chuàng)、轉(zhuǎn)載和分享為主,文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng),如果涉及侵權(quán)請(qǐng)聯(lián)系站長(zhǎng)郵箱:is@yisu.com進(jìn)行舉報(bào),并提供相關(guān)證據(jù),一經(jīng)查實(shí),將立刻刪除涉嫌侵權(quán)內(nèi)容。