How to apply a 'moving window' to analyse chunks of text sequentially in Python? -

-

i calculate simple moving window average type/ token ratio (ttr) of text sample. know how calculate ttr of whole text, or select first 50 words , calculate ttr that. think need create loop iterates on 50 words @ time, start moving +1 each time window moves through text, appending resulting ttr each window in list can average. it's looping/ chunking/ +1 part i'm stuck on.

this (think) want in loop. text has been lowered etc.:

window = text[0:50] wordcount = collections.counter(window) uniquewords = list(wordcount.keys()) ttr = (len(uniquewords))/(len(window))  windowsttr.append(ttr)

i have read other answers here, documentation enumerate , itertools.islice, still can't seem solve problem. gratefully receieved, i'm new python.

parametrize loop body according start position. iterate through possible start positions.

window_width = 50 last_index = len(text) - window_width start in range (last_index):     window = text[start:start+window_width]     wordcount = collections.counter(window)     uniquewords = list(wordcount.keys())     ttr = (len(uniquewords))/(len(window))      windowsttr.append(ttr)

if need take larger steps through text, parametrize that, well:

window_width = 50 last_index = len(text) - window_width step = 4    # shift 4 positions @ time start in range (0, last_index, step):

Comments

Post a Comment

Popular posts from this blog

ios - MKAnnotationView layer is not of expected type: MKLayer -

-
Image
so code works fine logger riddled message. there way rid of or suppress it? postannotation.swift class postannotation: mkpointannotation { //mark: properties let post: post //mark: initialization init(post: post) { self.post = post super.init() self.coordinate = cllocationcoordinate2d(latitude: post.latitude, longitude: post.longitude) self.title = post.title self.subtitle = post.timestring() } } adding annotation let annotation = postannotation(post: post) self.map.addannotation(annotation) func mapview func mapview(_ mapview: mkmapview, viewfor annotation: mkannotation) -> mkannotationview? { if annotation mkuserlocation { return nil } var annotationview = mapview.dequeuereusableannotationview(withidentifier: "pin") as? mkpinannotationview if annotationview == nil { annotationview = mkpinannotationview(annotation: annotation, reuseidentifier: "pin")
Read more

ZeroMQ on Windows, with Qt Creator -

-
i have installed zmq link given below on windows 7. http://zeromq.org/distro:microsoft-windows 1) have c++ project in qt-creator , i'm using zmq c++ binding (zhelpers.hpp etc). 2) have added .lib installed zmq folder qtcreator 3) while compiling, compiler looks _imp__zmq_verion, in .dll files present in .lib have __imp_zmq_version. 4) causing undefined reference zmq_version. anyone else faced problem , has solution ?
Read more

unity3d - Unity SceneManager.LoadScene quits application -

-
i have 2 different scenes 1 named 'main' , other 'game' both added scenes in load. when use scenemanager.loadscene("game"); works no problem when tried return main scene code if (input.getkeydown (keycode.escape)) { scenemanager.loadscene("main"); } strangely game quits. thanks. sorry interruption. somewhere on other script found code. if (input.getkeydown (keycode.escape)) { application.quit (); } that's bad, know...
Read more